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(54) Title: MULTICASTING METHOD AND APPARATUS 

(57) Abstract 

A scalable architecture is disclosed for delivery of 
real-time information over a communications network. Em- 
bedded into the architecture is a control mechanism (10) 
that provides for the management and administration (60) 
of users (40) who are to receive the real-time information. 
Preferably, there are multiple channels of information avail- 
able simultaneously to be delivered to users, each channel 
consisting of an independent stream of information. A user 
(40) chooses to tune in or tune out a particular channel, but 
does not choose the time at which the channel distributes its 
information. Advantageously, interactive (two-way) infor- 
mation can be incorporated into the system, multiple streams 
of information can be integrated for delivery to a user (40), 
and certain portions of the information being delivered can 
be tailored to the individual user (40). 



LLTTB CABLE »10ADCAST HAkDDttK 

BD RID MD FEED 

\ X X X 



ootfimoL 
Dfim 



FUMA*V 

vn 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL Albania 

AM Armenia 

AT Austria 

AU Australia 

AZ Azerbaijan 

BA Bosnia and Herzegovina 

BB Barbados 

BE Belgium 

BF Burkina Faso 

BG Bulgaria 

BJ Benin 

BR Brazil 

BY Belarus 

CA Canada 

CF Central African Republic 

CG Congo 

CH Switzerland 

CI C6te d lvoire 

CM Cameroon 

CN China 

CU Cuba 

CZ Czech Republic 

DE Germany 

DK Denmark 

EE Estonia 



ES 


Spain 


LS 


Lesotho 


SI 


FI 


Finland 


LT 


Lithuania 


SK 


FR 


France 


LU 


Luxembourg 


SN 


GA 


Gabon 


LV 


Latvia 


SZ 


GB 


United Kingdom 


MC 


Monaco 


TO 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


GH 


Ghana 


MC 


Madagascar 


TJ 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


GR 


Greece 




Republic of Macedonia 


TR 


HU 


Hungary 


ML 


Mali 


TT 


IE 


Ireland 


MN 


Mongolia 


UA 


IL 


Israel 


MR 


Mauritania 


UC 


IS 


Iceland 


MW 


Malawi 


US 


IT 


Italy 


MX 


Mexico 


uz 


JP 


Japan 


NE 


Niger 


VN 


KE 


Kenya 


NL 


Netherlands 


YU 


KG 


Kyrgyzsian 


NO 


Norway 


ZW 


KP 


Democratic People's 


NZ 


New Zealand 






Republic of Korea 


PL 


Poland 




KR 


Republic of Korea 


PT 


Portugal 




KZ 


Kazaksian 


RO 


Romania 




LC 


Sunt Lucia 


RU 


Russian Federation 




U 


Liechtenstein 


SD 


Sudan 




LK 


Sri Lanka 


SE 


Sweden 




LR 


Liberia 


SG 


Singapore 





Slovenia 

Slovakia 

Senegal 

Swaziland 

Chad 

Togo 

Tajikistan 

Turkmenistan 

Turkey 

Trinidad and Tobago 

Ukraine 

Uganda 

United Slates of America 

Uzbekistan 

Viet Nam 

Yugoslavia 

Zimbabwe 



MULTICASTING METHOD AND APPARATUS 

l. Field of the Invention 

This relates to a method and apparatus for providing 
5 audio and/ or visual communication services, in real-time to a 
multiplicity of identifiable users on a communications 
network, such as the Internet. In a preferred embodiment, 
the invention monitors which users are receiving signals on 
which one of a plurality of channels and modifies the content 
10 of at least some signals in response thereto. A particular 
application is to provide services akin to multi-channel 
radio or television with commercial programming content 
adjusted in accordance with the identity of the individual 
user. 

15 

2. Background of the Invention 

Systems such as the Internet typically are point- 
to-point (or unicast) systems in which a message is converted 
into a series of addressed packets which are routed from a 

2 0 source node through a plurality of routers to a destination 
node. In most communication protocols the packet includes a 
header which contains the addresses of the source and the 
destination nodes as well as a sequence number which 
specifies the packet's order in the message, 

25 In general, these systems do not have the 

capability of broadcasting a message from a source node to 
all the other nodes in the network because such a capability 
is rarely of much use and could easily overload the network. 
However, there are situations where it is desirable for one 

30 node to communicate with some subset of all the nodes. For 
example, multi-party conferencing capability analogous to 
that found in the public telephone system and broadcasting to 
a limited number of nodes are of considerable interest to 
users of packet-switched networks. To satisfy such demands, 

35 packets destined for several recipients have been 

encapsulated in a unicast packet and forwarded from a source 
to a point in a network where the packets have been 
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replicated and forwarded on to all desired recipients. This 
technique is known as IP Multicasting and the network over 
which such packets are routed is referred to as the Multicast 
Backbone or MBONE. More recently, routers have become 
5 available which can route the multicast addresses (class D 
addresses) provided for in communication protocols such as 
TCP/IP and UDP/IP. A multicast address is essentially an 
address for a group of host computers who have indicated 
their desire to participate in that group. Thus, a multicast 
10 packet can be routed from a source node through a plurality 
of multicast routers (or mrouters) to one or more devices 
receiving the multicast packets. From there the packet is 
distributed to all the host computers that are members of the 
multicast group. 

15 These techniques have been used to provide on the 

Internet audio and video conferencing as well as radio-like 
broadcasting to groups of interested parties. See, for 
example, K. Savetz et al . MBONE Multicasting Tomorrow's 
Internet (IDG Books Worldwide Inc., 1996). 

20 Further details concerning technical aspects of 

multicasting may be found in the Internet documents Request 
for Comments (RFC) 1112 and 14 58 which are reproduced at 
Appendices A and B of the Savetz book and in D.P. Brutaman et 
al., "MBONE provides Audio and Video Across the Internet," 
25 IEEE Computer, Vol. 27, No. 4, pp. 30-36 (April 1994), all of 
which are incorporated herein by reference. 

Citation of the foregoing documents is not to be 
construed as an admission that any of such documents is a 
prior art publication relative to the present invention. 

30 

3. Summary of the Invention 

The present invention is a scalable architecture 
for delivery of real-time information over a communications 
network. Embedded into the architecture is a control 
35 mechanism that provides for the management and administration 
of users who are to receive the real-time information. 
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In the preferred embodiment, the information being 
delivered is high-quality audio. However, it could also be 
video, graphics, text or any other type of information that 
can be transmitted over a digital network. This information 
5 is delivered in real-time to any number of widely distributed 
users. It is reai-tijne in that for a given channel of 
information, approximately the same information is being sent 
at approximately the same time to everyone who is enabled to 
receive the information. 

10 Preferably, there are multiple channels of 

information available simultaneously to be delivered to 
users, each channel consisting of an independent stream of 
information. A user chooses to tune in or tune out a 
particular channel, but does not choose the time at which the 

15 channel distributes its information. Advantageously, 

interactive (two-way) information can be incorporated into 
the system, multiple streams of information can be integrated 
for delivery to a user, and certain portions of the 
information being delivered can be tailored to the individual 

2 0 user. 

4 . Brief Description of the Drawing 

These and other objects, features and advantages of 
our invention will be more readily apparent from the 
25 following Detailed Description of a Preferred Embodiment of 
our invention in which 

Fig. 1 is a schematic diagram depicting an overview 
of the system of the present invention; 

Fig. 2 is a schematic diagram depicting the network 

3 0 control center for the system of Fig. 1; 

Fig. 3 is a schematic diagram depicting a unicast 
distribution structure; 

Fig. 4 is a schematic diagram depicting a multicast 
distribution structure; 
35 Fig. 5 is a schematic diagram depicting the 

connection between the media server and the user in the 
system of Fig. 1; 

- 3 - 
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Figs. 6-17 are timing diagrams which depict various 
aspects of the operation of the system of Fig. i; and 

Figs. 18 and 19 depict the user interface for 
control of the system of Fig. l. 
5 Where the same reference numerals appear in 

multiple drawings, the numerals refer to the same or 
corresponding structure in such drawings. 

5. Detailed Description of the Preferred Embodiment 

10 Referring to Fig. l, the system of the present 

invention comprises a Network Control Center 10, a plurality 
of Primary Servers 20, Media Servers 30, Users 4 0 and Control 
Servers 50 and an Administration Server 60. The servers are 
interconnected by a communications network, which in the 

15 preferred embodiment is the global connected internetwork 
known as the Internet. The Network Control Center 10 is the 
source of the information being distributed. It receives 
audio feeds from satellite, over the air broadcast or in 
other ways and processes this information for delivery over 

20 the network on multiple channels of information. This 

processing, consists of optionally recording the information 
for future broadcast and dynamically inserting paid 
commercial advertisements. 

For each channel of information, there is a Primary 

25 Server 2 0 that receives the stream of information from the 
Network Control Center 10 and compresses the information 
stream to allow for more efficient transmission. The Primary 
Servers 2 0 are directly connected to the network. 

The Primary Servers forward information via the 

30 network to a number of Media Servers 30. There may be a 
large number of Media Servers and in fact there may be many 
levels of Media Servers. For example, a Media Server which 
receives a stream of information from a Primary Server may 
forward that stream via the network to another Media Server 

35 which then forwards it to a User 40. This multilevel 

hierarchical structure is described in more detail below. 



- 4 - 



PCT/US97/07893 



The topology of the Internet dictates the ideal 
placement of Media servers, the fan-out of each Media Server 
and the number of levels of Media Servers between the Primary 
Server and Users. For example, the Media Servers which feed 
5 from a Primary Server might be placed at a major points of 
presence (POPs) of each of the large Internet service 
providers. These Media Servers might also be placed near 
clouds which serve as high bandwidth exchange points between 
the major carriers. Similarly, Media Servers which feed to 
10 Users might be placed on or close to networks which have a 
large number of subscribers to minimize the distance and 
number of data streams being transmitted. 

Control Servers 50 are responsible for keeping 
track of which Users are listening to which channels and for 
15 directing the Media Servers to start and stop streams of 
information to those Users. The Control Servers are also 
responsible for handling other interactions among the various 
components of the system as will be described in more detail 
below. Each Control Server is responsible for managing a 
20 cluster of Media Servers; and each Media Server is managed by 
a single Control Server at any given time. As a result, the 
Control Servers are distributed throughout the Internet, 
preferably located close to the Media Servers. 

The Administration Server 60 is responsible for 
25 registering new Users, authenticating Users who want to log 
onto the system, and maintaining audit logs for how many 
Users are listening to which channels and at which times. 
Maintaining audit logs and gathering statistics are features 
critical to monitoring the delivery of paid commercial 
30 messages as well as for other purposes. For example, for 

purposes of assessing copyright royalties, the audit logs can 
record the number of listeners for each musical or video 
selection that is distributed by the system. Another 
application is to determine the percentage of listeners who 
35 are interested in listening to a particular musical selection 
by determining how many listen to the entire selection and 
how many turn it off. 
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The system of the present invention can be 
considered a distribution architecture integrated with a 
control architecture. The distribution architecture handles 
scalable real-time delivery of information to any number of 
5 Users on a packet switched network, such as the Internet. 
The control architecture represents a second scalable system 
integrated with the distribution architecture for managing 
and administering the delivery of that information. 

The remainder of this description is divided into 
10 three sections. In the next section the distribution 

architecture will be described in more detail. Following 
that, the control architecture will be described. In the 
third section the User interface will be illustrated. 

15 I. Distribution Architecture 

The distribution architecture provides for the 
delivery of real-time information to any number of Users 
distributed throughout a network. As will be described in 
2 0 detail below, the distribution architecture is scalable to 
allow for efficient delivery of multiple simultaneous 
information channels in real-time to a large number of Users. 

In the preferred embodiment, the information which 
is being distributed consists of high-quality audio in 

2 5 addition to other information. It should be appreciated that 

the basic architecture and other general principles set forth 
herein would also apply to the delivery of video, graphics, 
text or any other type of information that can be delivered 
over a digital network. In addition, it should be 

3 0 appreciated that an information stream can consist of audio 

with supplemental information such as text and graphic images 
and commands to control software running on the User's 
computer . 

The source of information in the preferred 
35 embodiment is the Network Control Center 10, depicted in the 
schematic diagram of Fig, 2. Control Centers of this type of 
design are available from Broadcast Electronics, Inc. and are 
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similar to what would be found in a conventional radio 
station serving multiple frequencies. 

Referring to Fig. 2, the incoming signal can be 
received in a variety of ways such as from a satellite, over- 
5 the-air broadcast, cable or hard disk. It is then processed 
by Receiver/Decoder 110 , which decodes the signal and 
provides an incoming audio stream. Routing Switcher 12 0 is 
responsible for routing the incoming audio feed from the 
Receiver to either Delay Recording Workstation 14 0 or to one 

10 of the Playback/Control Workstations 130. Real-time 

insertion of paid commercial advertising takes place at the 
Playback/Control Workstations and the resulting integrated 
audio stream is delivered to the Primary Servers. The Delay 
Recording Workstation is responsible for recording an 

15 incoming broadcast so that it can be played back at a later 
time. 

Supervisory Workstation 150 is responsible for 
managing and controlling the Playback/ Control Workstations, 
Delay Recording Workstations and other computers as may be 

20 connected to the local area network within the Network 

Control Center. Production Workstation 160 and AudioVAULT- 
NFS Server 170 are used to manipulate audio samples, such as 
commercial messages for use by the Playback/Control 
Workstations. The audio being delivered can consist of 

25 syndicated TV or radio programs, such as would be received 
over satellite or cable and delivered as described above. 
These can be delivered live and/or played back at a later 
time. It is also possible for the delivery of information, 
such as music, to take place from information that is all 

30 stored locally such as on a hard disk. A new play list and 
its associated music data can then be downloaded periodically 
to update the channel. Additionally, it is possible to 
deliver commercial-free programming, for example public 
service announcements or label-specific music. 

35 In the preferred embodiment the Primary Servers are 

responsible for compressing the audio stream using an 
advanced perceptual technique developed and licensed by AT&T 

- 7 - 
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Corp. and Lucent Technologies, Inc. This highly 
sophisticated algorithm is used to maximize the benefit of 
the bandwidth available. Advantageously, two bitrates are 
available, a first rate of approximately 20Kbps and a second 
5 rate of approximately 56Kbps. Using the perceptual 

technique, the quality of the first rate is similar to FM 
monaural (with a sampling rate of approximately 22,000 16-bit 
samples per second) and the second rate is close to CD 
quality stereo (with a sampling rate of approximately 32,000 
10 16-bit samples in stereo each second) . The signals at the 
two different bitrates comprise two different audio channels 
and thus require two different compression processes. 

The computational requirements of compressing an 
audio stream in real time using techniques such as the 
15 advanced perceptual technique are approximately 100% of a 
Pentium-Pro 2 00Mhz computer and the computational 
requirements of decompressing an audio stream in real time 
are approximately 30% of a Pentium 75Mhz computer. Future 
improvements and/or changes to the algorithm could 
2 0 significantly change these requirements. For the present, a 
dedicated computer is required within the Primary Server to 
compress the audio stream. The decompression process takes 
place on end Users' computers and preferably would use only a 
portion of the computers' computational requirements, 
25 allowing the computers to be used for other tasks while they 
are processing the audio stream. 

It is important to appreciate that the compression 
and decompression techniques employed by the present 
invention are not critical to the overall operation of the 
30 system and the advantages obtained therefrom could be 
obtained with other compression methodologies. 
Advantageously, the identity of the compression technique 
used can be encoded into the audio stream in the packet 
header. This makes it possible to identify to the receiver 
35 the nature of the decompression algorithm to use; and thereby 
make it possible for the computer within the Primary Server 
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to select an optimum compression algorithm depending on the 
nature of the audio stream to be compressed. 

The remainder of the distribution architecture 
comprises the multilevel hierarchy of data transmission 
5 originating at the Primary Server 2 0 and terminating at the 
Users 4 0 as shown in Figure 3, In the preferred embodiment, 
the network is the global connected Internet. It can also 
include private networks which are connected to the Internet 
and it could be implemented on any packet switched network, 
10 cable-modem-based or satellite-based cable system. It is 
possible that certain links within the overall system, for 
example, the link between the Primary Server and the first 
level of Media Servers, are private data links which carry 
only data associated with this system. This could also be 
15 true of other data transmission paths in the distribution 
architecture. The User receiving the information preferably 
can be anyone who has access to the Internet with sufficient 
bandwidth to receive the resulting audio data. 

It should be appreciated that the distribution 
20 architecture of the present invention provides for 

scalability. Using such a structure, any number of Users, 
and as widely distributed as necessary, can be accommodated. 
In the preferred embodiment, the fan-out at each level of 
Media Server (given the state of technology today) is on the 
25 order of ten, but the same structure could be applied with 
other fan-outs. The location and fan-out of the Media 
Servers is chosen to minimize overall network bandwidth 
consumed . 

The flow of information from Primary Server 20 
30 through network to User 4 0 is based on the delivery of a 
continuous sequence of individual pieces of information, or 
packets. Thus the distribution architecture implements a 
form of multicast packet delivery to a group. The group in 
this case is the set of all Users who are listening to a 
35 given channe « at a given time. Group membership is dynamic, 
Users can start and stop listening to a channel at any time. 
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Multicasting can be implemented in a variety of 
ways, any or all of which can be used in the present 
invention. In the preferred embodiment, the Media Servers 
receive unicast packet streams and they then duplicate these 
5 streams into more unicast streams to other Media Servers 
which are in the membership group for that stream. The 
lowest level Media Servers use hardware broadcast, multicast 
and/ or unicast to reach all Users served by that Media 
Server. 

10 If the Media Server is directly connected to the 

same physical network as the User, hardware broadcast or 
multicast can be used to transmit the packet stream to all 
Users listening at that time on that network. In this case 
the Media Servers can translate the incoming packets into 

15 broadcast or multicast packets for transmission on the local 
network. Only a single packet is transmitted at-a-tiroe on 
the local network and any computer directly connected to the 
local network can receive that packet. Hardware multicast is 
built into most networks and it is lower in overall overhead 

2 0 than hardware broadcast since computers not interested in a 
transmission do not have to process the packets. In the case 
that a Media Server is serving a User who is not on the same 
physical network, a unicast transmission is used to reach 
that User, which requires a separate packet transmission for 

25 each User so connected. In the preferred embodiment, the 
assignment of Users to Media Servers is done using control 
transactions among the User 40, Control Servers 50, and 
Administration Server 60. This system will be described more 
fully in the following section. 

30 Multicasting can also be implemented within the 

Internet at the IP level using IP class D addresses and the 
IGMP group control protocol. Fig. 4 illustrates how the 
multilevel hierarchical distribution architecture would 
operate using IP multicast delivery. Under this system, a 

35 packet is transmitted with a multicast address for a 

destination and each router maintains group membership lists 
for each interface that it is connected to and will forward 
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packets across the Internet to other routers such that all 
Users within the global group eventually receive a copy of 
the packet. Unless and until all routers within the Internet 
understand multicasting in this way, it is necessary to 
5 supplement it with IP tunneling in which multicast packets 
are encapsulated in unicast packets and routed by unicast 
routers to a multicast routers. The present invention can 
and will be able to take advantage of IP multicasting as it 
becomes widely available. Each channel of information would 
10 be given its own class D address and the Media Server would 
then simply transmit packets using the appropriate IP 
destination address. In this case no Media Servers would be 
used as this function would be accomplished by the routers in 
use to store and forward other IP packets. 
15 Thus it can be appreciated that the implementation 

of the multicast delivery structure can be implemented using 
a combination of IP unicast, IP multicast and hardware 
multicast or any other system which provides for distributed 
delivery of information to a specific group of destinations. 
2 0 It is expected that special relationships with Internet 

providers will be established so that delivery of the audio 
steams can take place with a guaranteed bandwidth and in the 
most efficient way possible. 

In the preferred embodiment, packets of information 
25 for distribution use the UDP protocol under IP rather than 
the TCP protocol. TCP provides for reliable stream delivery 
but at the cost of retransmission and delays. For real-time 
information, it is usually more appropriate to use UDP since 
the information is time critical and low latency is more 
30 important that reliability. Since TCP is a point-to-point 
protocol, it is incompatible with IP multicasting. However, 
TCP could be used on the IP unicast links between Media 
Servers which are expected to have very low packet loss. In 
order to handle out of order, lost, duplicate and corrupted 
35 packets, the UDP packets are serialized. 

In the preferred embodiment the size of the audio 
packets being transmitted is variable and can change on a 
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packet by packet basis. It is expected that when using 
compression schemes that have a fixed bit rate, such as 
ADPCM, all packets for that stream would be the same size. 
Alternatively when using a variable bit rate compression 
5 algorithm, it is expected that packet size would vary so as 
to establish approximately the same amount of time for each 
sample. For example, if each packet corresponds to a 20 
millisecond segment of speech, this could correspond to 100 
bytes during one time period and 200 bytes during another. 
10 Additionally, the Media Server may choose to dynamically vary 
the packet size to accommodate changes in network conditions. 

Since the resulting playback of audio information 
is sensitive to packet loss and network congestion, software 
running on the various computers which make up this system 
15 monitor the ongoing situation and adapt to it in the best 

possible way. This may involve using different Media Servers 
and/or lowering the data rate to the User. For example, 
similar to analog dynamic signal quality negotiation present 
in many analog radio receivers, the User software may request 
20 a lower bitrate until the situation is improved. Also, note 
that the audio information being delivered to the User is 
preferably interleaved so that a contiguous segment of the 
audiostream is distributed for transmission over several 
packets. As a result, the loss of one packet is spread out 
25 over multiple audio samples and causes minimal degradation in 
audio. Advantageously, a small degree of redundancy may be 
incorporated within the audio stream to further guard against 
packet loss. 

Preferably, there are two bitrate options available 
30 to the User for audio delivery. These are approximately 
20Kbps for standard audio and approximately 56Kbps for high 
quality audio. Thus, a 28.8Kbps modem connection over an 
analog phone line is sufficient to listen to standard audio 
broadcasts. To listen to high quality audio, an ISDN 
35 connection to the Internet is required, or some other 

connection with greater than 56Kbps bandwidth. It should be 
appreciated that higher bandwidths are currently becoming 
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available to end Users. In particular the use of cable 
modems and residential fiber networks are enhancing the 
bandwidths available to Users and thus making broadcasts of 
higher bitrates more practical. 
5 in addition to the content of the audio channel 

being delivered, it is also possible to deliver out of band 
of side-bar information such as graphics, images and text. 
This side-bar information is synchronized with the audio 
channel. This may only involve small increases in bandwidth 
10 requirements, such as l-2Kbps. For example a music program 
could deliver images of an album cover, the text of song 
lyrics, or URLs for use by a Web browser. The User can 
preferably choose to have the side-bar information show up 
automatically or be hidden. It is also possible to 
15 incorporate two-way interaction into the system, such that 
for example Users can participate in a global chat session 
during the audio broadcast. These and other details are 
explained in more detail below under the description of the 
User interface. 
20 The delivery of paid commercial advertising 

information is an important aspect of the present invention. 
Advertising may be incorporated into the audio stream within 
the Network Control Center as described above. It may also 
be incorporated into the audio stream at the User level, or 
25 at some intermediate point in the distribution architecture. 
In addition, the side-bar information discussed above can 
also include advertising content. Fig. 5 illustrates the 
provision to the User of two separate streams 32, 34 of 
packets, one of which may be used for advertising. In this 
30 case the insertion of the stream of commercial advertising 
into the non-commercial stream occurs on the User's computer. 
Fig. 5 also illustrates packet stream 36 which identifies 
the User to the system. This enables the system to monitor 
which Users are listening to which channels and also allows 
35 the system to vary, for example, the advertising content 
delivered to a User. 
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One advantage of this alternative is to allow 
targeted commercial delivery based on the individual User. 
That is, an individual User would receive the main audio feed 
plus a particular advertising stream unique to his 
5 demographic group. Note that the advertising stream 

typically is lower in overall bitrate and generally does not 
require real-time delivery, thus lowering the overall load on 
the network. For example, the advertising stream could be 
delivered to the User in advance of the regular programming, 

10 stored in a buffer in the User's computer and inserted into 
the stream of regular programming upon receipt of a cueing 
signal embedded in the stream of regular programming. Thus, 
a substantial number of targeted groups, perhaps 10 or 100 or 
even more could be accommodated without an impractical 

15 increase in network load. 

II- Control Architecture 

The control architecture described in this section 
is responsible for managing and administering the Users who 

2 0 are receiving the information being delivered by the 

distribution architecture described, in the previous section. 
The control architecture handles new User registration, User 
login, the starting and stopping of audio streams and the 
monitoring of ongoing transmissions. The control 

25 architecture is scalable just as is the distribution 

architecture so that any number of Users can be managed. 

This section describes the control protocol, which 
consists of the format and sequence of control messages that 
are exchanged among Users, Control Servers, Media Servers, 

30 Primary Servers and the Administration Server. These 

messages are in the form of objects, which have specific data 
formats. Objects are exchanged preferably using the TCP 
protocol although other options are possible. Below we 
describe the sequence of objects passed among the various 

35 computers and detail the internal structure of each object. 
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The major objects used in the present embodiment of 
the invention are set forth in Table l. For each object, 
Table 1 provides a brief description of its function, 
identification of the names of the fields in the object, 
5 their types and a brief description of their function. 



TABLE 1 



Channel Activation Object 



10 



Contains information used for channel activation/ deactivation It is sent 
to Media and Primary Servers to tell them to carry or stop carrying a 
specific channel. Media Servers get the channel from another server in 
the system hierarchy and Primary Servers get and encode the feed from 
the actual input source. 



15 



FicJd Name 

Token 

Moniker 

Activate 

CompressType 
Host 



Field Type 

Security Token Object 
Moniker Object 
Int 

Int 

Host Object 



Remarks 



unique channel identifier 
action flag (activate/deactivate) 
type of compression to use 
host carrying the channel 



20 



Channel Guide Object 



Contains analytical and descriptive information for an item requested 
that is uniquely identified by a moniker. It is usually the reply to a 
Channel Guide Request object. 



25 



Field Name 

Token 

Type 

Result 



Field Type 

Security Token Object 
Int 



Remarks 



type of content 

the content data itself 



Channel Guide Request Object 



30 



Conveys a request for analytical and descriptive information about an 
item uniquely identified by the contained moniker. The reply is in the 
form of a Channel Guide object. 



35 



Field Name 

Token 

Type 

Moniker 



Field Type 

Security Token Object 
Int 

Moniker Object 



Remarks 

inherited from base class 
type of content 
unique identifier 
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Table 1 (continued) 



Host Object 



Encapsulates the attributes of a networked computer related to the 



Field Name 


Field Type 


Remarks 


Token 


Security Token Object 




HostName 


String 


computer name and domain 


PortNumber 


Int 


port number for service 


DisplayName 


String 


descriptive computer name 



10 



Login Information Object 



Encapsulates the name and password by which a User is known to the 

System. 



15 



Field Name 

Token 
Login 
Password 



Field Type 

Security Token Object 

String 

String 



Remarks 



User's system login name 
User's system password (possibly 
encrypted) 



20 



Media Control Interface (MCI) Request Object 

Encapsulates a multimedia control command, such as play and stop, and 
any extra information that may be necessary to perform the requested 
service. 



25 



Field Name 


Field Type 


Remarks 


Token 


Security Token Object 




Command 


Int 


multimedia command 


String 


String 


command-specific extra info 





Moniker Object 



30 



A moniker encapsulates the name of an object or process with the 
intelligence necessary to work with that name. In other words, it 
provides naming and binding services. The Moniker Object is used in 
the system for unique identification of various components, parts or 
features, such as a channel, a directory, or a computer list. 





Field Name 


Field Type 


Remarks 




Token 


Security Token Object 




35 


ID 


String 


unique string identifier 




DisplayName 


String 


User-readable name 
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Table 1 (continued) 

Ping Object 

Ping is the name given to the "Are-You-Alive?" operation useful in 
determining if a specific computer is up and running. This object is 
used in the system when a server has to be queried for its operational 
status. It can also provide timing information for statistical purposes 
and quality of service evaluations. 





Field Name 


Field Type Remarks 


10 


Token 

Date 

Time 


Security Token Object 

Date system date 

T * me system time 










Protocol List Object 






Encapsulates a general purpose collection object. 


IS 


Field Name 


Field Type Remarks 




Token 
Type 


Security Token Object 

Inl type of object list 










Result Message Object 




O ft 


Acts as the acknowledgment for a requested service successfully carried 
that out or reports errors that occur in the system during a client/server 
transaction. 




Field Name 


Field Type Remarks 


25 


Token 
Code 
Message 


Security Token Object 

I nl result code 

St ™£ message corresponding to code 










Security Token Object 




30 


Contains the authorization key for a transaction. The key must be 
validated before any service is performed. 




Field Name 


Field Type Remarks 




ID 


Slrin £ authorization key/transaction ID. 



35 
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Server Activation Object 



Table J (continued) 



Contains information used in the server activation! deactivation process. 
Used for announcement as well as command purposes (e.g., a server can 
notify the administration database that is now activated or a server can 
be instructed to manage someone else). 



10 



Field Name 

Token 
Active 
Manage 

Type 
Host 



Field Type 

Security Token Object 

Im 

lni 

Int 

Host Object 



Remarks 



action flag (activate/deactivate) 
control flag (manage/associate) 
server type 
host to be controlled 



Servpr fjet Rvnuwt Oh 



15 



Encapsulates a request for a list of available server resources for an 
identified service (e.g., a request for a list of Control Servers for a 
specified channel). 



20 



Field Name 

Token 
Type 
Moniker 
Host 



Field Type 

Security Token Object 
int 

Moniker Object 
Host Object 



Remarks 



type of service 

content/channel unique identifier 
local host information 



Statistics Object 



25 



Contains system-related information that can be used by load- 
balancing algorithms and for statistical pu rposes. 
Field Name Field Type 



Remarks 



30 



Token 

Load 

Threads 

Users 

Uptime 

NumberManaged 
NumberAssociated 



Security Token Object 

Int 

Int 

Int 

Int 

Int 

Int 



load on the system 
number of threads running 
number of Users being 
serviced 

amount of time running 
number of managed servers 
number of associated servers 



35 
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Statistics Request Object 



Encapsulates a request for system-related information that can be used 
by load-balancing algorithms and statistical purposes. 



5 



10 



Field Name 


Field Type 


Remarks 


Token 

Load 

Threads 

Users 

Uptime 

NumberManaged 
NumberAssociated 


Security Token Object 

Int 

Int 

Int 

Int - . 

Int 

Ini 


request flag (on/off) 
request flag (on/off) 
request flag (on /off) 
request flag (on/off) 
request flag (on/off) 
request flag < on/of 0 



User Object 



Users and Servers use this object to register themselves with the 
administration database. They provide the information for subsequent 
logins (name, password) and other system-related info. The end-Users 

15 provide personal, demographic, and system-related info rmation. 

Field Name Field Type Remarks 

login information<name, password) 
User's first name 
User's last name 
User's job title 
User's employer 
User's home street address 
User's address extra 
city, village 

state, province or foreign country 
zip or postal code 
User's age 
User's gender 
telephone number 
fax number 
email address 

market-targeting extra User info 
system-related information 

30 ~ — 



35 



25 



Token 


Security Token Object 


Login 


Login Information Object 


FirstName 


String 


LastName 


String 


Title 


String 


Company 


String 


Address] 


String 


Address! 


String 


City 


String 


State 


String 


ZipCode 


String 


Age 


String 


Gender 


String 


PhoneNumber 


String 


FaxNumber 


String 


Email 


String 


Demographics 


Dictionary 


Systemlnfo 


Dictionary 
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7flWe 7 (continued) 

Version Object 

All components of the system use this object to report their versioning 
information to the party they transact with in order to use a protocol 
they both understand. They are also given the chance to update 
themselves if a newer version exists. 



Field Name Field Type Remarks 

Token Security Token Object 

Major Int major protocol version number 

Minor lnt minor protocol version number 

Type Int sender type 

Clieni Version client version information 



Unlike traditional protocols based on state 
computers, the control protocol of the present invention is a 
light-weight, stateless protocol comprising simple sequences 

5 of objects. It is light-weight in that in most sequences 
only two objects are involved in the transaction and after a 
sequence is completed the connection can be reused. It is 
also statBlsss in that the server maintains no information 
about the client. Every transaction is handled independently 

0 of the previous ones. States exist in the lower levels, for 
example within the TCP layer, to express logical states of a 
network connection but they are not actually part of the 
control protocol. 

In the preferred embodiment, the software running 

5 on the Control Servers, Media Servers and Primary Servers is 
programmed for Windows NT and UNIX environment using the OLE 
environment. In addition, COM interfaces are used between 
components. The Rogue Wave system is used to transfer 
objects between the applications running on the various 

0 computers. The software running on the User computer is 

preferably programmed for a Windows 32-bit environment, so it 
will run on a Windows 95 or Windows NT computer. 
Alternatively, Macintosh and UNIX environments can be 
accommodated by other User software. 

5 The basic process of a control transaction consists 

of a version sequence followed by one or more protocol 
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sequences. The version sequence starts after the computer 
initiating the transaction, the client, has established a 
connection with the computer completing the transaction, the 
server. The client sends a Version Object (defined in Table 
5 1) and in response the server then sends back its own Version 
Object. This version sequence is used so that both client 
and server are aware of the version numbers of the software 
they are using. If a version number is older than expected, 
either client or server can choose to conform to the previous 

10 version or abort the transaction, depending on its needs and 
capabilities. If a version number is newer than expected, in 
most cases the current transaction can be completed since the 
software systems are designed to be fully backward compatible 
with previous versions. Additionally, in the case that the 

15 server of the transaction is the Administration Server, the 
client receives information about what the latest version 
number is and thus the client can be informed that a software 
update is needed. The process of handling automatic updating 
of User software is described more fully below. 

2 0 After the version sequence, one or more protocol 

sequences occur in which other objects are exchanged between 
client and server. When a particular protocol sequence is 
completed, another independent protocol sequence can be 
serviced. The protocol sequences that are part of the 

25 control architecture of the present invention are summarized 
in Table 2 and described below in conjunction with Figures 6- 
17. 



30 



35 
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TABLE 2 



Summary of Protocol Sequences 



20 



30 



j Control Sequence 

5 

User Registration 
and Login 
(see Fig. 6) 


|| Client 
User 


Server 

Administration 


Main Objects Exchanged 

Version Object 

User Object 

Channel Guide Object 


User Login 
} (see Fig. 7) 


User 


Administration 


Version Object 

Login Information Object 

Channel Guide Object 


Channel Play 
(see Figs 8a, 8B, 
8C) 


User 


Control 
Media 


Version Objeci 
Server List Object 

Version Object 
Server List Object 

Version Object 
MCI Objects - 

OPEN/PLAY/STOP/CLOSE 
Ping Objects 

(TCP connection stays open) 


Token Validation 
(see Figs. 9A, 
9B) 


Control or 
Media or 
Primary 


Administration or 
Control 


Version Object 
oecuniy loxen Object 


Server 

Registration and 
Login 

(see Fig. 10) 


Media or 
Control 


Administration 


Version Object 

user vjoject 

Server Activation Object 


Server Login 
(see Fig. 11) 


Media or 
Control 


Administration 


Version Object 

Login Object 

Server Activation Object 


Control Server 
Activation 
(see Fig. 12) 


Administration 


Control 


Version Object 

Server Activation Object 



35 
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Control Sequence 


Client 


Server 


Mam Objects Exchanged 


5 


Media Server 
Activation 

(see Fig. 13) 


Control 


Media 


Version Object 

Server Activation Object 

Ping Objects 

(TCP connection stays open) 




Control Channel 
Activation 
(see Fig. 14) 


Administration 


Control 


Version Object 

Channel Activation Obiect 


10 


Media Channel 
Activation 
(see Fig. 15) 


Control 


Media 


(open TCP connection) 
Channel Activation Objects 


15 


Distribution 
Activation 
(see Fig. 16) 


Media 


Media or 
Primary 


Version Object 
MCI Objects - 

OPEN/PLAY/STOP/CLOSE 
Ping Objects 

(TCP connection stays open) 


J 


Statistics Request 
(see Fig. 17) 


Administration 


f"Y>ntrn1 nr 

Media 


version uoject 
Statistics Object 



The User registration and login sequences are the 
processes by which a new User registers with the system, logs 
in and retrieves programming information. The channel play 
sequence takes place when a User asks to listen to a 
particular channel. The token validation sequence is used to 
verify that a computer requesting a service is authorized to 
do so. The Server registration, login and activation 
sequences are used by Control and Media Servers when they 
become active. The Control Server and Media Server 
activation sequences are used to manage the Control and Media 
Servers. The control channel, media channel and distribution 
activation sequences are used to cause a channel to be 
distributed to a Media Server. Finally, the statistics 
request is used for administrative purposes. 
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Fig. 6 illustrates the User registration and login 
sequence in more detail- This sequence takes place after the 
User has installed the User software on his/her computer. It 
is expected that the User will download the software from the 
5 Internet and then invoke it which in the preferred embodiment 
will use the Windows Wizard interface. This will guide the 
User through the installation process including filling out 
the registration form, which we will describe more fully in 
the next section. After the User has selected a name and 
10 password and selected the option to register, the User 

computer opens a TCP connection to the Administration Server. 
Advantageously, the full domain name of the Administration 
Server is embedded into the User software, although it could 
be discovered in other ways. The User and Administration 
15 Server then exchange version objects with the Administration 
Server as described above. if the version numbers meet 
expectations, the User sends a User Object to the 
Administration Server. The format of the User Object is 
shown in Table 1. Once the Administration Server receives 
20 the User Object, it verifies that the information is filled 
in properly and that the selected. User name is unique. If 
the User Object is invalid for any reason, the Administration 
Server returns a Result Message Object with a code indicating 
the reason. The format of the Result Message Object is shown 
25 in Table 1. if the User information is valid, the 

Administration Server updates the global database of User 
names and passwords and then generates a security token for 
that User. This security token is then returned to the User 
in a Result Message Object. 
30 u P°n receiving the Result Message Object, the User 

saves the security token for future use. This token is an 
identifier that allows the User to request services from the 
Administration Server and other computers within the overall 
system. The security token is not saved permanently or 
35 registered on the User computer. Normally, the User software 
then immediately sends a Channel Guide Request Object to the 
Administration Server and a Channel Guide Object is returned. 
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The format of these objects is also shown in Table l. Note 
that in principle, this is a separate transaction and could 
take place in a separate TCP connection to the Administration 
Server. In particular, once the User has registered and 
5 logged in, he/she can request the Channel Guide Object again 
since it may have been updated since the previous request. 
At this point the TCP connection to the Administration server 
is closed. 

The process of User registration only needs to take 
10 place once for each User. However anyone can re-register at 
any time, even after the software has been installed. In 
particular, it is expected that if multiple persons use a 
computer, each person will register and obtain his/her own 
User name and password. If the registration process is not 
15 completed successfully, the User software saves the 

registration information and ask the User if they would like 
to try again the next time the software is invoked. 

Since the security token is not permanently saved 
by the User software, it is lost when the User software is 
20 closed, and the security token must again be retrieved from 
the Administration Server the next time the User wants to use 
the system. This process is the purpose of the login 
sequence illustrated in Fig. 7. This sequence is used if a 
User has already registered and needs only to retrieve a 
25 valid security token. In this case the sequence consists of 
the User's sending a Login Information Object to the 
Administration Server. The Administration Server then 
queries the User database to validate the login name and 
password. If the login name and password are correct, then a 
30 security token is returned to the User. Normally the receipt 
of the security token will immediately be followed by a 
channel information request sequence, just as in the 
registration sequence described previously. 

The control sequence that takes place when a User 
35 initiates a channel play operation is illustrated in Figs. 
8A, 8B and 8C. First the User software requests a Control 
Server List from the Administration Server. Note that the 
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Server List Request Object, illustrated in Table 1 contains a 
channel identifier. The Administration Server generates a 
sorted list of Control Servers based on overall system load 
and the location of the User on the network and returns this 
5 list to the User using a Protocol List Object. Once the 
Control Server List is returned to the User, the 
Administration Server is no longer needed and the TCP 
connection is closed. 

The User software then searches the list of Control 
10 Servers and opens a TCP connection to the first host listed. 
If that host computer does not respond, then the next Control 
Server on the list is tested and so forth in succession. 
Upon obtaining a response from a Control Server, the User 
software uses a Server List Request Object to requests a 
15 Media Server List from the Control Server. if the Control 
Server is too busy to service the User, it returns a Result 
Message Object so indicating and the User software tries the 
next Control Server on the list. However, in the likely 
scenario that the Control Server is able to handle the User's 
20 request, a sorted list of Media Servers is generated and 
returned to the User computer using a Protocol List Object. 
The TCP connection to the Control Server is then closed by 
the User software. 

At this point the User software initiates a TCP 
25 connection to the first Media Server on the list provided by 
the Control Server. As in the previous case, it attempts to 
connect to the first host on the list and if unsuccessful 
tries the next hosts in succession. Once the Version Objects 
are exchanged, the User software sends an MCI Request Object 
30 to the Media Server. An MCI Request Object can be used for 
four basic commands: OPEN, PLAY, STOP and CLOSE. The User 
software must first send an OPEN command for the desired 
channel. If the returned Result Message Object indicates 
success, the User software then sends a PLAY command. 
35 When the Media Server receives a valid PLAY 

command, it initiates the delivery of audio information to 
the User as described in the previous section. Note that 
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this could be in the form of broadcast, multicast or unicast 
packets to a specific UDP port. The TCP connection through 
which the MCI Request Objects were sent stays open during the 
audio play operation. In addition, Ping Objects are sent to 
5 the User on a periodic basis to verify that the computer is 
still working and active. When the User software receives a 
Ping Object, it simply returns it. The Media Server uses the 
Ping Objects to measure round trip time and also to determine 
when a User's computer has terminated abnormally. in that 
10 case the audio stream is terminated. 

In the case of normal termination of the audio 
stream, the User makes an explicit selection to stop and this 
causes a STOP command to be sent to the Media Server in an 
MCI Request Object. The Media Server then terminates the 
15 audio stream to that User, When the User closes the 

application software or selects another channel to play, the 
User software will send a CLOSE command to the Media Server 
in an MCI Request Object and the TCP connection is closed. 

The initiation of the audio stream by the Media 
20 Server causes a log entry to be generated and sent to the 

Administration Server. This information is important so that 
the Administration Server can update its database to indicate 
which Users are listening to which channels. The security 
token is used to identify the User initiating the audio 
25 stream. Additionally, when the audio stream is terminated to 
any User, another log message is generated and sent to the 
Administration Server. 

Fig. 9A illustrates the process by which security 
tokens are validated. The Administration Server is the only 
30 server that can validate a security token. Thus, when a User 
requests services from a Control Server or from a Media 
Server, that server must go back to the Administration Server 
with a token validation sequence. However, Control Servers 
and Media Servers are allowed to cache validations of 
35 security tokens so that they do not have to validate tokens 
repeatedly once they have validated it the first time. In 
the case where a Media Server receives a request, the token 
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will be validated with the Control Server that is managing 
that Media Server. Fig. 9B identifies the various token 
validation scenarios. 

Fig. 10 illustrates the process by which a new 
5 server is registered. This process is similar to new User 
registration. It is expected, however, that the server 
installation will be through a Web interface rather than a 
Wizard. The Administration Server, upon receiving a User 
Object from a Media Server or Control Server validates the 
10 User name and password and generate a security token just as 
in the case of User registration. Normally the Server then 
immediately sends back a Server Activation Object indicating 
that it is ready to be used as a system resource. Once this 
process has been completed, the TCP connection to the 
15 Administration Server is closed. 

If a Media Server or Control Server that has sent a 
Server Activation Object to the Administration Server becomes 
inactive, it will send another Server Activation Object 
indicating this condition. In the case of a Media Server, 
20 this object is sent to the managing Control Server. In the 
case of a Control Server, this object sent to the 
Administration Server. As in the case of User registration, 
Media Server and Control Server registration needs only take 
place once per computer. However, if the computer is 
25 restarted, the server must login and again retrieve a 
security token. This is the server login and activation 
sequence shown in Figure 11. 

Once a Control Server has indicated to the 
Administration Server that it is ready, the Administration 
30 Server can activate that Control Server by sending the 

Control Server a Server Activation Object as illustrated in 
Fig. 12. This is a separate transaction and is used to tell 
the Control Server which Media Servers it is supposed to 
manage. Recall that a Control Server and a number of Media 
35 Servers form a cluster of Media Servers. The single Control 
Server that manages that cluster must be given a list of host 
computers corresponding to the Media Servers in that cluster. 
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The process by which a Control Server activates the 
Media Servers that it manages is illustrated in Fig. 13. The 
Control Server sends a Server Activation Object to the Media 
Server indicating that it is responsible for channel 
5 management. This TCP connection between the Control Server 
and the Media Server stays open during the time that both 
servers are active. The Control Server periodically sends 
Ping Objects to the Media Server across this open TCP 
connection to verify that the' Media Server is still running. 
10 Fi< 3- 14 illustrates the process by which a given 

channel is activated by the Administration Server. The 
Administration Server opens a connection to a Control Server 
that its wishes to have carry a given channel and provide a 
Channel Activation Object. This object indicates to the 
15 Control Server which Media or Primary Server the Control 
Server should direct its Media Servers to get the feed from. 
At this point the Control Server is said to be carrying that 
channel and it will be a valid host on a list of Control 
Servers requested by a Channel Play sequence. 
20 Fi <*- 15 illustrates what happens when a Control 

Server needs to provide a channel. First it sends a Channel 
Activation Object to one of the Media Servers that it manages 
across the open TCP connection described previously. This 
object indicates to the Media Server that it should start 
25 receiving the channel identified and from where it should 
receive it. 

In Figs. 16A and 16B depict how the Media Server 
requests distribution of an audio channel from another Media 
Server or from a Primary Server. This sequence is much the 

30 same as that in which a User requests the distribution of 
audio information from a Media Server. Note that a Media 
Server receives a single incoming stream for each channel 
that it is carrying and will then redistributes this stream 
to all Users or other Media Servers that request it. 

35 Finally, Fig. 17 illustrates the statistics request 

sequence. This sequence is used by the Administration Server 
to gather information from the Media Servers and Control 
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Servers in order to manage the overall system. It can use 
this information to detect failures and to balance load as 
the dynamic conditions change. As indicated above, it can 
also use this information to monitor which Users are 
5 listening to which channel or whether Users stop listening to 
a channel at any time, such as during the play of a 
particular song. It can also use this information to control 
the advertising content that is downloaded to a particular 
User in advance of receipt of regular audio programming 
10 and/or monitor the delivery of advertising to the Users. 

The control architecture described in this section 
is scalable to handle any number of Users. Note that the 
User registration process only happens once for each 
subscriber and the login process only happens once per 
15 session. These interactions, which require the 

Administration Server are expected to constitute a very small 
percentage of the overall system bandwidth. If the 
Administration Server were to become a bottleneck, however, 
it would be possible to duplicate it and to have the database 
20 it maintains distributed and automatically updated to 
guarantee consistency. 

The Control Servers are distributed throughout the 
network and can handle the lower level interactions with the 
Users and the Media Servers, A single Control Server can 
25 handle preferably on the order of ten Media Servers up to 
several hundred Users. The bitrate among the Users, the 
Control Servers and the Media Servers is expected to be small 
in comparison to the audio transmission bitrate. The Ping 
Objects normally only involve the User and the nearest Media 
30 Server. They are also low in overhead since they are small 
and only get transmitted infrequently. 

III. User Interface 

The User interface is provided by the client application 
35 running on an individual computer and its associated 

graphical interface. In the preferred embodiment the User 
interface is available for 32-bit Windows (95 and NT) , 
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Macintosh and UNIX platforms. Preferably anyone on the 
Internet can freely download a copy of the client software 
and install it in their computer. 

Figure 18 illustrates the main User screen in the 
5 preferred embodiment. The screen is composed of three 
sections: channel guide (upper left frame) , program guide 
(upper right frame) , and multimedia frame (lower half of 
screen) . The channel guide lists, as a tree hierarchy, the 
channels that are available from the system. The User 

10 selects a channel from the list of those displayed on the 
channel guide. The program guide provides information 
pertaining to the channel selected. This information can be 
a detailed schedule of the programming that has played or 
will be playing on the channel selected. Additionally, other 

15 relevant information will be displayed in this frame, for 
example, a notice regarding an upcoming special event on 
another channel. The multimedia frame provides an integrated 
web browser that displays information via a series of tabbed 
sections. 

20 The information contained in the channel guide, program 

guide, and the tabs of the multimedia frame is dynamically 
transmitted to the client. For example, if a new channel 
begins operation, the client application can immediately 
display it as being available. Furthermore, the tabs 

2 5 displayed can be specifically relevant depending on what song 

is playing. For example, tabs displaying the album cover, 
information on the artist, song lyrics, tour dates can be 
displayed. Additionally, as shown in the example in figure 
18, a tab can be available allowing the User to place an 

3 0 order for the CD or allowing the User to participate in a 

chat session related to the channel. 

Figure 19 illustrates the key pull-down menus available 
in the main User screen in the preferred embodiment. Table 3 
provides a description of each of the functions available 
35 through the pull down menus, as shown in figure 19. 
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As will be apparent to those skilled in the art 
numerous modifications may be made within the spirit 'and 
scope of the invention. 



10 



15 



Table 3 
Pull-Down Menu Functions 




Edit 



Properties 



Minimizes the scre en. 
Allows tne user to copy the 
selection on to the 
clipboard. 



Allows rne User to set 
various properties. 



Play 



| Stop 



Begins playing the selected 
channel . 



20 



stops playing the selected 
channel . 



Mute 

Tool Bar 



stops the playing of audio* 



Display or hide the tool bar 
(providing access to pull- 
down menu functions) 



Status Bar 



25 



uispiay or nide the status 
bar normally situated at 
bottom of the screen 



Help 



Help Topics 
About . . . 



Display or nide the tool bar 
section that provides access 
to the web browser functions. 



30 



urings up a list ot available 
online help topics . 
Displays summary mtirmation 
regarding this application, 
such as version number, 
copyright information, and so 
on. 



35 
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What is claimed is: 

1. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and /or 
5 visual information into a plurality of streams of addressed 
digital packets complying with the specifications of a 
network communication protocol, 

for each stream, routing such stream to one or more 

users, 

10 controlling the routing of the stream of packets in 

response to selection signals received from the users, and 
monitoring the reception of packets by the users 
and accumulating records which indicate which streams of 
packets were received by which users. 

15 

2. The method of claim l further comprising the step 
of including in at least one stream of packets at least some 
advertising information. 

20 3 - The method of claim 2 further comprising the step 

of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided. 

25 4 - Tne method of claim 2 wherein the advertising 

information is inserted into the stream of audio and/or 
visual information before such stream is converted into a 
stream of packets. 

30 5 - The method of claim l further comprising the step 

of generating an audio output and/or a visual display from 
the stream of packets received by the user. 

6. The method of claim l further comprising the steps 

35 of: 

storing a first stream of packets received by the 
user at a first time and 
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at a later time, inserting the first stream of 
packets into a second stream of packets received at the user. 

7. The method of claim 6 further comprising the step 
5 of converting the combined first and second streams of 

packets into an audio output and/or visual display, 

8. The method of claim 6 wherein the first stream of 
packets contains advertising information. 

10 

9* The method of claim 6 wherein the content of the 
advertising information is varied depending on the identity 
of the user. 

15 10. The method of claim 2 wherein the records that are 

accumulated indicate how many users received specific 
advert is ing inf ormat ion . 

11. The method of claim 1 wherein at least one stream 
20 of packets comprises copyrighted music selections and the 

records that are accumulated, indicate- how many users received 
specific music selections. 

12. The method of claim 1 wherein at least one stream 
25 of packets comprise music selections and the records that are 

accumulated indicate how many users did or did not listen to 
the entire selection. 

13. The method of claim 1 further comprising the steps 

30 of: 

compressing the stream of packets in their passage 
from source to user, and 

decompressing the stream of packets near the user. 

35 14. The method of claim 3 where in the compressing step 

uses a compression algorithm that is selected in accordance 
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with the content of the information being communicated in the 
stream of packets. 

15. The method of claim 4 wherein the compressing step 
5 inserts into each packet an identification of the compression 
algorithm used and the decompressing step monitors each 
packet to read such identification and to vary its 
decompression algorithm in response thereto. 

1° 16. A method for transmitting at least one stream of 

audio and/or visual information over a communications network 
to a plurality of users comprising the steps of: 

controlling the routing of the stream of 
information through the network in response to selection 
15 signals received from the users, and 

monitoring the reception of the stream of 
information by the users and accumulating records relating to 
the reception of the stream of information by the users. 

20 I 7 - The method of claim 16 further comprising the step 

of including in at least one stream of information at least 
some advertising information. 

18. The method of claim 17 further comprising the step 
25 of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided • 



19. The method of claim 16 further comprising the steps 

30 of: 

storing a first stream of information received by 
the user at a first time and 

at a later time, inserting the first stream of 
information into a second stream of information received by 
35 the user. 
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20. The method of claim 19 wherein the first stream of 
information contains advertising information. 

21. The method of claim 17 wherein the records that are 
5 accumulated indicate how many users received specific 

advertising information. 

22. The method of claim 17 wherein at least one stream 
of packets comprises copyrighted music selections and the 

10 records that are accumulated indicate how many users received 
specific music selections. 

23. The method of claim 17 wherein at least one stream 
of packets comprise music selections and the records that are 

15 accumulated indicate how many users did or did not listen to 
the entire selection. 

24. The method of claim 17 further comprising the steps 

of: 

20 compressing the stream of information in its 

passage from source to user, and 

decompressing the stream of information near the 

user. 

25 25. The method of claim 24 wherein the compressing step 

uses a compression algorithm that is selected in accordance 
with the concent of the information being communicated in the 
stream of information. 

30 26. The method of claim 16 wherein multiple streams of 

audio and/or visual information are transmitted over the 
communications network and the user can select which stream 
to receive. 

35 27. A communication system comprising: 

means for converting at least one stream of audio 
and/or visual information into a stream of addressed digital 
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packets complying with the specifications of a network 
communication protocol , 

means for routing such stream via a communication 
network to selected users, 
5 means for controlling the routing of the stream of 

packets in response to selection signals received from the 
users, and 

means for monitoring the reception of packets by 
the user and for accumulating' records which indicate which 
10 streams of packets were received by which users. 

28. The communication system of claim 27 further 
comprising means for including in the stream of packets at 
least some advertising information. 

15 

29. The communication system of claim 28 further 
comprising means for varying the content of the advertising 
information with the identity of the user to whom the 
advertising information is provided. 

20 

30. The communication system of claim 27 further 
comprising means for generating from the stream of packets 
received at the user an audio output and/ or a visual display. 

25 31 • The communication system of claim 27 further 

comprising means for storing packets received at the user 
during a first time period and means for inserting such 
packets into other packets received at the user at a later 
time period. 

30 

32. The communication system of claim 31 wherein the 
stream of packets received during the first time period 
contains advertising information. 

35 33. The communication system of claim 32 wherein the 

content of the advertising information is varied depending on 
the identity of the user. 
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34. The communication system of claim 27 further 
comprising: 

means for compressing the stream of packets in 
their passage from source to user, and 
5 downstream of the compressing means, means for 

decompressing the stream of packets. 

35. The conununication system of claim 34 wherein the 
compressing means is located near the converting means and 

10 the decompressing means is located at the user. 

36. The communication system of claim 34 wherein the 
compressing means uses a compression algorithm that is 
selected in accordance with the content of the information 

15 being communicated in the stream of packets. 

37. The communication system of claim 34 wherein the 
compressing means inserts into each packet an identification 
of the compression algorithm used and the decompressing means 

2 0 monitors each packet to read such identification and to vary 
its decompression algorithm in response thereto. 



25 



30 



35 
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FIGURE 6 
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FIGURE 8B 
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FIGURE 8C 
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FIGURE 9A 
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FIGURE 10 
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FIGURE 11 
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FIGURE 12 
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FIGURE 13 
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FIGURE 14 
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Figure 18 
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AMENDED CLAIMS 

[received by the International Bureau on 24 November 1997 (24.11.97); 
original claims 1, 12, 14-16, 22, 23 and 27 amended; new claims 38-51 added; 
remaining claims unchanged (10 pages)] 

1. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/ or 
5 visual information into a plurality of streams of addressed 
digital packets complying with the specifications of a 
network communication protocol, 

for each stream, routing such stream to one or more 

users , 

10 controlling the routing of the stream of packets in 

response to selection signals received from the users, and 
monitoring the reception of packets by the users 
and accumulating records that indicate which streams of 
packets were received by which users, wherein at least one 

15 stream of packets comprises an audio and/ or visual selection 
and the records that are accumulated indicate the time that a 
user starts receiving the audio and/ or visual selection and 
the time that the user stops receiving the audio and/or 
visual selection. 

20 

2. The method of claim 1 further comprising the step 
of including in at least one stream of packets at least some 
advertising information. 

25 3. The method of claim 2 further comprising the step 

of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided. 

30 4. The method of claim 2 wherein the advertising 

information is inserted into the stream of audio and/or 
visual information before such stream is converted into a 
stream of packets. 

35 5. The method of claim 1 further comprising the step 

of generating an audio output and/or a visual display from 
the stream of packets received by the user. 
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6. The method of claim i further comprising the steps 

of : 

storing a first stream of packets received by the 
user at a first time and 

5 at a later time, inserting the first stream of 

packets into a second stream of packets received at the user. 

7. The method of claim e- further comprising the step 
of converting the combined first and second streams of 

10 packets into an audio output and/or visual display. 



S. The method of claim 6 wherein the first stream of 
packets contains advertising information. 

15 9 * The met k°d of claim 6 wherein the content of the 

advertising information is varied depending on the identity 
of the user. 

.10. The method of claim 2 wherein the records that are 
20 accumulated indicate how many users received specific 
advertising information. 



11. The method of claim 1 wherein at least one stream 
of packets comprises copyrighted music selections and the 

25 records that are accumulated indicate how many users received 
specific music selections. 

12. The method of claim l wherein at least one stream 

of packets comprises music selections and the records that 

30 are accumulated indicate how many users did or did not listen 
to the entire selection. 



of: 



13. The method of claim l further comprising the steps 



35 



compressing the stream of packets in their passage 
from source to user, and 

decompressing the stream of packets near the user. 
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14. The method of claim 13 wherein the compressing step 
uses a compression algorithm that is selected in accordance 
with the content of the information being communicated in the 
stream of packets, 

5 

15. The method of claim 14 wherein the compressing step 
inserts into each packet an identification of the compression 
algorithm used and the decompressing step monitors each 
packet to read such identification and to vary its 

10 decompression algorithm in response thereto. 

16. A method for transmitting at least one stream of 
audio and/or visual information over a communications network 
to a plurality of users comprising the steps of: 

15 controlling the routing of the stream of 

information through the network in response to selection 
signals received from the users, and 

monitoring the reception of the stream of 
information by the users and accumulating records relating to 

2 0 the reception of the stream of information by the users, 

wherein at least one stream of information comprises an audio 
and /or visual selection and the records that are accumulated 
indicate the time that a user starts receiving the audio 
and/ or visual selection and the time that the user stops 

25 receiving the audio and/or visual selection. 

17. The method of claim 16 further comprising the step 
of including in at least one stream of information at least 
some advertising information. 

30 

18. The method of claim 17 further comprising the step 
of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided. 

35 

19. The method of claim 16 further comprising the steps 

of: 
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storing a first stream of information received by 
the user at a first time and 

at a later time, inserting the first stream of 
information into a second stream of information received by 
5 the user. 



20. The method of claim 19 wherein the first stream of 
information contains advertising information. 

10 21. The method of claim 17 wherein the records that are 

accumulated indicate how many users received specific 
advertising information . 

22. The method of claim 17 wherein at least one stream 
15 of information comprises copyrighted music selections and the 

records that are accumulated indicate how many users received 
specific music selections. 

23. The method of claim 17 wherein at least one stream 
20 of information comprises music selections and the records 

that are accumulated indicate how many users did or did not 
listen to the entire selection. 

24. The method of claim 17 further comprising the steps 

25 of: 

compressing the stream of information in its 
passage from source to user, and 

decompressing the stream of information near the 

user. 

30 

25. The method of claim 24 wherein the compressing step 
uses a compression algorithm that is selected in accordance 
with the content of the information being communicated in the 
stream of information. 

35 

26. The method of claim 16 wherein multiple streams of 
audio and/ or visual information are transmitted over the 
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communications network and the user can select which stream 
to receive . 

27. A communication system comprising: 

5 means for converting at least one stream of audio 

and/ or visual information into a stream of addressed digital 
packets complying with the specifications of a network 
communication protocol, 

means for routing such stream via a communication 
10 network to selected users, 

means for controlling the routing of the stream of 
packets in response to selection signals received from the 
users, and 

means for monitoring the reception of packets by 
15 the user and for accumulating records that indicate which 
streams of packets were received by which users, wherein at 
least one stream of packets comprises an audio and/ or visual 
selection, and the means for monitoring further includes 
means for accumulating records that indicate the time that a 
2 0 user starts receiving the audio and/or visual selection and 
the time that the user stops receiving the audio and /or 
visual selection • 

28. The communication system of claim 27 further 

2 5 comprising means for including in the stream of packets at 
least some advertising information. 

29. The communication system of claim 28 further 
comprising means for varying the content of the advertising 

30 information with the identity of the user to whom the 
advertising information is provided. 

30. The communication system of claim 2 7 further 
comprising means for generating from the stream of packets 

35 received at the user an audio output and/or a visual display. 
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31. The communication system of claim 27 further 
comprising means for storing packets received at the user 
during a first time period and means for inserting such 
packets into other packets received at the user at a later 

5 time period. 

32. The communication system of claim 31 wherein the 
stream of packets received during the first time period 
contains advertising information. 

10 

33. The communication system of claim 32 wherein the 
content of the advertising information is varied depending on 
the identity of the user. 

15 34 • The communication system of claim 27 further 

comprising: 

means for compressing the stream of packets in 
their passage from source to user, and 

downstream of the compressing means, means for 
2 0 decompressing the stream of packets . 

35. The communication system of claim 34 wherein the 
compressing means is located near the converting means and 
the decompressing means is located at the user. 

25 

36. The communication system of claim 34 wherein the 
compressing means uses a compression algorithm that is 
selected in accordance with the content of the information 
being communicated in the stream of packets. 

30 

37. The communication system of claim 34 wherein the 
compressing means inserts into each packet an identification 
of the compression algorithm used and the decompressing means 
monitors each packet to read such identification and to vary 

35 its decompression algorithm in response thereto. 
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38. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/ or 
visual information into a plurality of streams of addressed 
5 digital packets complying with the specifications of a 
network communication protocol, 

for each stream, routing such stream to one or more 

users, 

controlling the routing of the stream of packets in 
10 response to selection signals received from the users, and 
monitoring the reception of packets by the users 
and accumulating records that indicate which streams of 
packets were received by which users, wherein at least one 
stream of packets comprises music selections and the records 
15 that are accumulated indicate how many users did or did not 
listen to the entire selection. 

39. A method for transmitting at least one stream of 
audio and/or visual information over a communications network 

20 to a plurality of users comprising the steps of: 

controlling the routing of the stream of 
information through the network in response to selection 
signals received from the users, and 

monitoring the reception of the stream of 

25 information by the users and accumulating records relating to 
the reception of the stream of information by the users, 
wherein at least one stream of information comprises music 
selections and the records that are accumulated indicate how 
many users did or did not listen to the entire selection. 

30 

40. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/or 
visual information into a plurality of streams of addressed 
35 digital packets complying with the specifications of a 
network communication protocol, 

-45- 



AMENDED SHEET (ARTICLE 19) 



WO 97/42582 



PCT/US97/07893 



for each stream, routing such stream to one or more 

users , 

controlling the routing of the stream of packets in 
response to selection signals received from the users, and 
5 monitoring the reception of packets by the users 

and accumulating records that indicate which streams of 
packets were received by which users, wherein at least one 
stream of packets comprises an^audio and/or visual selection 
and the records that are accumulated indicate the elapsed 
10 time that a user received the audio and/or visual selection. 

41- A method for transmitting at least one stream of 
audio and/or visual information over a communications network 
to a plurality of users comprising the steps of: 

15 controlling the routing of the stream of 

information through the network in response to selection 
signals received from the users, and 

monitoring the reception of the stream of 
information by the users and accumulating records relating to 

2 0 the reception of the stream of information by the users, 

wherein at least one stream of information comprises an audio 
and/or visual selection and the records that are accumulated 
indicate the elapsed time that a user received the audio 
and/ or visual selection, 

25 

42. A communication system comprising: 

means for converting at least one stream of audio 
and/or visual information into a stream of addressed digital 
packets complying with the specifications of a network 
30 communication protocol, 

means for routing such stream via a communication 
network to selected users, 

means for controlling the routing of the stream of 
packets in response to selection signals received from the 
35 users, and 

means for monitoring the reception of packets by 
the user and for accumulating records that indicate which 
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streams of packets were received by which users, wherein at 
least one stream of packets comprises an audio and/ or visual 
selection, and the means for monitoring further includes 
means for accumulating records that indicate the elapsed time 
5 that a user received the audio and/ or visual selection. 

43. The method of claim 2 wherein the records that are 
accumulated indicate which users received specific 
advertising information. 

10 

44. The method of claim 1 wherein at least one stream 
of packets comprises copyrighted music selections and the 
records that are accumulated indicate which users received 
specific music selections. 

15 

45. The method of claim 17 wherein the records that are 
accumulated indicate which users received specific 

advert i s ing inf orma t ion . 

20 46. The method of claim 16 wherein at least one stream 

of information comprises copyrighted music selections and the 
records that are accumulated indicate which users received 
specific music selections. 

25 47. The communication system of claim 28 wherein the 

means for monitoring further accumulates records that 
indicate which users received specific advertising 
information. 



30 48. The communication system of claim 27 wherein at 

least one stream of packets comprises copyrighted music 
selections and the means for monitoring further accumulates 
records that indicate which users received specific music 
selections. 

35 

49. The method of claim 1 further comprising the steps 

of: 
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storing a first stream of packets received by the user 
at a first time and 

inserting the first stream of packets into a plurality 
of streams of packets received at the user at a plurality of 



5 later times. 



50 



of 



The method of claim 16 further comprising the steps 



storing a first stream of information received by the 
10 user at a first time and 

inserting the first stream of information into a 
plurality of streams of information received at the user at a 
plurality of later times. 



15 



51. The method of claim 27 further comprising means for 
storing packets received at the user during a first time 
period and means for inserting such packets into other 
packets received at the user at a plurality of later time 
periods. 

20 



25 



30 



35 
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(57) Abstract 

A scalable architecture is disclosed for delivery of 
real-time information over a communications network. Em- 
bedded into the architecture is a control mechanism (10) 
that provides for the management and administration (60) 
of users (40) who are to receive the real-time information. 
Preferably, there are multiple channels of information avail- 
able simultaneously to be delivered to users, each channel 
consisting of an independent stream of information. A user 
(40) chooses to tune in or tune out a particular channel, but 
does not choose the time at which the channel distributes its 
information. Advantageously, interactive (two-way) infor- 
mation can be incorporated into the system, multiple streams 
of information can be integrated for delivery to a user (40), 
and certain portions of the information being delivered can 
be tailored to the individual user (40). 
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MULTICASTING METHOD AND APPARATUS 

1. Field of the Invention 

This relates to a method and apparatus for providing 
5 audio and/or visual communication services, in real-time to a 
multiplicity of identifiable users on a communications 
network, such as the Internet. In a preferred embodiment, 
the invention monitors which users are receiving signals on 
which one of a plurality of channels and modifies the content 
10 of at least some signals in response thereto. A particular 
application is to provide services akin to multi-channel 
radio or television with commercial programming content 
adjusted in accordance with the identity of the individual 
user. 

15 

2. Background of the invention 

Systems such as the Internet typically are point- 
to-point (or unicast) systems in which a message is converted 
into a series of addressed packets which are routed from a 

2 0 source node through a plurality of routers to a destination 
node. In most communication protocols the packet includes a 
header which contains the addresses of the source and the 
destination nodes as well as a sequence number which 
specifies the packet's order in the message* 

25 In general, these systems do not have the 

capability of broadcasting a message from a source node to 
all the other nodes in the network because such a capability 
is rarely of much use and could easily overload the network. 
However, there are situations where it is desirable for one 

30 node to communicate with some subset of all the nodes. For 
example, multi-party conferencing capability analogous to 
that found in the public telephone system and broadcasting to 
a limited number of nodes are of considerable interest to 
users of packet-switched networks. To satisfy such demands, 

35 packets destined for several recipients have been 

encapsulated in a unicast packet and forwarded from a source 
to a point in a network where the packets have been 
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replicated and forwarded on to all desired recipients. This 
technique is known as IP Multicasting and the network over 
which such packets are routed is referred to as the Multicast 
Backbone or MBONE. More recently, routers have become 
5 available which can route the multicast addresses (class D 
addresses) provided for in communication protocols such as 
TCP/IP and UDP/IP. a multicast address is essentially an 
address for a group of host computers who have indicated 
their desire to participate in that group. Thus, a multicast 
10 packet can be routed from a source node through a plurality 
of multicast routers (or mrouters) to one or more devices 
receiving the multicast packets. Prnn, th«r 0 ^ 

w i-fti^ivcu _L2b 

distributed to all the host computers that are members of the 
multicast group. 

15 Tnese techniques have been used to provide on the 

internet audio and video conferencing as well as radio-like 
broadcasting to groups of interested parties. See, for 
example, K. Savetz et al . MBONE Multicasting Wmu>c 
Internet (IDG Books Worldwide Inc., 1996). 
20 Further details concerning technical aspects of 

multicasting may be found in the Internet documents Request 
for comments (RFC) 1112 and 1458 which are reproduced at 
Appendices A and B of the Savetz book and in D. P. Brutaman et 
al., -MBONE provides Audio and Video Across the Internet," 
25 IEEE Computer , Vol. 27, No. 4, pp. 30-36 (April 1994), all of 
which are incorporated herein by reference. 

Citation of the foregoing documents is not to be 
construed as an admission that any of such documents is a 
prior art publication relative to the present invention. 



30 



3. Summary of the Invention 

The present invention is a scalable architecture 
for delivery of real-time information over a communications 
network. Embedded into the architecture is a control 
35 mechanism that provides for the management and administration 
of users who are to receive the real-time information. 
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In the preferred embodiment, the information being 
delivered is high-quality audio. However, it could also be 
video, graphics, text or any other type of information that 
can be transmitted over a digital network. This information 
5 is delivered in real-time to any number of widely distributed 
users. It is real-tijne in that for a given channel of 
information, approximately the same information is being sent 
at approximately the same time to everyone who is enabled to 
receive the information. 

10 Preferably, there are multiple channels of 

information available simultaneously to be delivered to 
users, each channel consisting of an independent stream of 
information. A user chooses to tune in or tune out a 
particular channel, but does not choose the time at which the 

15 channel distributes its information. Advantageously, 

interactive (two-way) information can be incorporated into 
the system, multiple streams of information can be integrated 
for delivery to a user, and certain portions of the 
information being delivered can be tailored to the individual 

20 user. 

4, Brief Description of the Drawing 

These and other objects, features and advantages of 
our invention will be more readily apparent from the 
25 following Detailed Description of a Preferred Embodiment of 
our invention in which 

Fig. 1 is a schematic diagram depicting an overview 
of the system of the present invention; 

Fig. 2 is a schematic diagram depicting the network 
30 control center for the system of Fig. 1; 

Fig. 3 is a schematic diagram depicting a unicast 
distribution structure; 

Fig. 4 is a schematic diagram depicting a multicast 
distribution structure; 
35 Fig. 5 is a schematic diagram depicting the 

connection between the media server and the user in the 
system of Fig. 1; 
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Figs. 6-17 are timing diagrams which depict various 
aspects of the operation of the system of Fig. l; and 

Figs, is and 19 depict the user interface for 
control of the system of Fig. l. 

5 Where the same reference numerals appear in 

multiple drawings, the numerals refer to the same or 
corresponding structure in such drawings. 

5. Detailed Description of the Preferred Embodiment 

10 Referring to Fig. 1, the system of the present 

invention comprises a Network Control Center 10, a plurality 

of Primary Servers 20, Media Servers in t^^c »n 

Servers 50 and an Administration Server 60. The servers are 
interconnected by a communications network, which in the 
15 preferred embodiment is the global connected internetwork 
known as the Internet. The Network Control Center 10 is the 
source of the information being distributed. It receives 
audio feeds from satellite, over the air broadcast or in 
other ways and processes this information for delivery over 
2 0 the network on multiple channels of information. This 

processing consists of optionally recording the information 
for future broadcast and dynamically inserting paid 
commercial advertisements. 

For each channel of information, there is a Primary 
25 Server 20 that receives the stream of information from the 
Network Control Center 10 and compresses the information 
stream to allow for more efficient transmission. The Primary 
Servers 20 are directly connected to the network. 

The Primary Servers forward information via the 
30 network to a number of Media Servers 30. There may be a 
large number of Media Servers and in fact there may be many 
levels of Media Servers. For example, a Media Server which 
receives a stream of information from a Primary Server may 
forward that stream via the network to another Media Server 
35 which then forwards it to a User 40. This multilevel 
hierarchical structure is described in more detail below. 
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The topology of the Internet dictates the ideal 
placement of Media Servers, the fan-out of each Media Server 
and the number of levels of Media Servers between the Primary 
Server and Users. For example, the Media Servers which feed 
5 from a Primary Server might be placed at a major points of 
presence (POPs) of each of the large Internet service 
providers. These Media Servers might also be placed near 
clouds which serve as high bandwidth exchange points between 
the major carriers. Similarly, Media Servers which feed to 

10 Users might be placed on or close to networks which have a 
large number of subscribers to minimize the distance and 
number of data streams being transmitted. 

Control Servers 50 are responsible for keeping 
track of which Users are listening to which channels and for 

15 directing the Media Servers to start and stop streams of 
information to those Users. The Control Servers are also 
responsible for handling other interactions among the various 
components of the system as will be described in more detail 
below. Each Control Server is responsible for managing a 

2 0 cluster of Media Servers; and each Media Server is managed by 
a single Control Server at any given time. As a result, the 
Control Servers are distributed throughout the Internet, 
preferably located close to the Media Servers. 

The Administration Server 60 is responsible for 

25 registering new Users, authenticating Users who want to log 
onto the system, and maintaining audit logs for how many 
Users are listening to which channels and at which times. 
Maintaining audit logs and gathering statistics are features 
critical to monitoring the delivery of paid commercial 

30 messages as well as for other purposes. For example, for 

purposes of assessing copyright royalties, the audit logs can 
record the number of listeners for each musical or video 
selection that is distributed by the system. Another 
application is to determine the percentage of listeners who 

35 are interested in listening to a particular musical selection 
by determining how many listen to the entire selection and 
how many turn it off. 
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The system of the present invention can be 
considered a distribution architecture integrated with a 
control architecture. The distribution architecture handles 
scalable real-time delivery of information to any number of 
5 Users on a packet switched network, such as the Internet. 
The control architecture represents a second scalable system 
integrated with the distribution architecture for managing 
and administering the delivery of that information. 

The remainder of this description is divided into 
10 three sections. In the next section the distribution 

architecture will be described in more detail. Following 
that, the control architecture will be described. in the 
third section the User interface will be illustrated. 

15 I. Distribution Architecture 

The distribution architecture provides for the 
delivery of real-time information to any number of Users 
distributed throughout a network. As will be described in 
2 0 detail below, the distribution architecture is scalable to 
allow for efficient delivery of multiple simultaneous 
information channels in real-time to a large number of Users. 

In the preferred embodiment, the information which 
is being distributed consists of high-quality audio in 
25 addition to other information. It should be appreciated that 
the basic architecture and other general principles set forth 
herein would also apply to the delivery of video, graphics, 
text or any other type of information that can be delivered 
over a digital network. In addition, it should be 
30 appreciated that an information stream can consist of audio 
with supplemental information such as text and graphic images 
and commands to control software running on the User's 
computer . 

The source of information in the preferred 
35 embodiment is the Network Control Center 10, depicted in the 
schematic diagram of Fig. 2. Control Centers of this type of 
design are available from Broadcast Electronics, Inc. and are 
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similar to what would be found in a conventional radio 
station serving multiple frequencies. 

Referring to Fig. 2, the incoming signal can be 
received in a variety of ways such as from a satellite, over- 
5 the-air broadcast, cable or hard disk. It is then processed 
by Receiver/Decoder 110, which decodes the signal and 
provides an incoming audio stream. Routing Switcher 12 0 is 
responsible for routing the incoming audio feed from the 
Receiver to either Delay Recording Workstation 14 0 or to one 

10 of the Playback/ Control Workstations 13 0. Real-time 

insertion of paid commercial advertising takes place at the 
Playback/Control Workstations and the resulting integrated 
audio stream is delivered to the Primary Servers. The Delay 
Recording Workstation is responsible for recording an 

15 incoming broadcast so that it can be played back at a later 
time. 

Supervisory Workstation 150 is responsible for 
managing and controlling the Playback /Control Workstations, 
Delay Recording Workstations and other computers as may be 

2 0 connected to the local area network within the Network 

Control Center. Production Workstation 160 and AudioVAULT- 
NFS Server 170 are used to manipulate audio samples, such as 
commercial messages for use by the Playback/ Control 
Workstations. The audio being delivered can consist of 

25 syndicated TV or radio programs, such as would be received 
over satellite or cable and delivered as described above. 
These can be delivered live and/or played back at a later 
time. It is also possible for the delivery of information, 
such as music, to take place from information that is all 

30 stored locally such as on a hard disk. A new play list and 
its associated music data can then be downloaded periodically 
to update the channel. Additionally, it is possible to 
deliver commercial-free programming, for example public 
service announcements or label-specific music. 

35 In the preferred embodiment the Primary Servers are 

responsible for compressing the audio stream using an 
advanced perceptual technique developed and licensed by AT&T 
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Corp. and Lucent Technologies, Inc. This highly 
sophisticated algorithm is used to maximize the benefit of 
the bandwidth available. Advantageously, two bitrates are 
available, a first rate of approximately 20Kbps and a second 
5 rate of approximately 56Kbps. Using the perceptual 

technique, the quality of the first rate is similar to FM 
monaural (with a sampling rate of approximately 22,000 16-bit 
samples per second) and the second rate is close to CD 
quality stereo (with a sampling rate of approximately 32,000 
10 16-bit samples in stereo each second) . The signals at the 
two different bitrates comprise two different audio channels 
and thus require two different compression processes. 

The computational requirements of compressing an 
audio stream in real time using techniques such as the 
15 advanced perceptual technique are approximately 100% of a 
Pentium-Pro 200Mhz computer and the computational 
requirements of decompressing an audio stream in real time 
are approximately 30% of a Pentium 75Mhz computer. Future 
improvements and/or changes to the algorithm could 
2 0 significantly change these requirements. For the present, a 
dedicated computer is required within the Primary Server to 
compress the audio stream. The decompression process takes 
place on end Users' computers and preferably would use only a 
portion of the computers' computational requirements, 
25 allowing the computers to be used for other tasks while they 
are processing the audio stream. 

It is important to appreciate that the compression 
and decompression techniques employed by the present 
invention are not critical to the overall operation of the 
30 system and the advantages obtained therefrom could be 
obtained with other compression methodologies. 
Advantageously, the identity of the compression technique 
used can be encoded into the audio stream in the packet 
header. This makes it possible to identify to the receiver 
35 the nature of the decompression algorithm to use; and thereby 
make it possible for the computer within the Primary Server 
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to select an optimum compression algorithm depending on the 
nature of the audio stream to be compressed. 

The remainder of the distribution architecture 
comprises the multilevel hierarchy of data transmission 
5 originating at the Primary Server 2 0 and terminating at the 
Users 4 0 as shown in Figure 3. In the preferred embodiment, 
the network is the global connected Internet. It can also 
include private networks which are connected to the Internet 
and it could be implemented on any packet switched network, 

10 cable-modem-based or satellite-based cable system. It is 
possible that certain links within the overall system, for 
example, the link between the Primary Server and the first 
level of Media Servers, are private data links which carry 
only data associated with this system. This could also be 

15 true of other data transmission paths in the distribution 
architecture. The User receiving the information preferably 
can be anyone who has access to the Internet with sufficient 
bandwidth to receive the resulting audio data. 

It should be appreciated that the distribution 

2 0 architecture of the present invention provides for 

scalability. Using such a structure, any number of Users, 
and as widely distributed as necessary, can be accommodated. 
In the preferred embodiment, the fan-out at each level of 
Media Server (given the state of technology today) is on the 
25 order of ten, but the same structure could be applied with 
other fan-outs. The location and fan-out of the Media 
Servers is chosen to minimize overall network bandwidth 
consumed . 

The flow of information from Primary Server 20 

3 0 through network to User 4 0 is based on the delivery of a 

continuous sequence of individual pieces of information, or 
packets. Thus the distribution architecture implements a 
form of multicast packet delivery to a group. The group in 
this case is the set of all Users who are listening to a 
35 given channe at a given time. Group membership is dynamic, 
Users can start and stop listening to a channel at any time. 
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Multicasting can be implemented in a variety of 
ways, any or all of which can be used in the present 
invention. In the preferred embodiment, the Media Servers 
receive unicast packet streams and they then duplicate these 
5 streams into more unicast streams to other Media Servers 
which are in the membership group for that stream. The 
lowest level Media Servers use hardware broadcast, multicast 
and/or unicast to reach all Users served by that Media 
Server . 

10 If the Med ia Server is directly connected to the 

same physical network as the User, hardware broadcast or 
multicast can be used to transmit t-.he n a ^ 0 f 
Users listening at that time on that network. m this case 
the Media Servers can translate the incoming packets into 
15 broadcast or multicast packets for transmission on the local 
network. Only a single packet is transmitted at-a-time on 
the local network and any computer directly connected to the 
local network can receive that packet. Hardware multicast is 
built into most networks and it is lower in overall overhead 
2 0 than hardware broadcast since computers not interested in a 
transmission do not have to process the packets. In the case 
that a Media Server is serving a User who is not on the same 
physical network, a unicast transmission is used to reach 
that User, which requires a separate packet transmission for 
25 each User so connected. In the preferred embodiment, the 
assignment of Users to Media Servers is done using control 
transactions among the User 40, Control Servers 50, and 
Administration Server 60. This system will be described more 
fully in the following section. 
30 Multicasting can also be implemented within the 

Internet at the IP level using IP class D addresses and the 
IGMP group control protocol. Fig. 4 illustrates how the 
multilevel hierarchical distribution architecture would 
operate using IP multicast delivery. Under this system, a 
35 packet is transmitted with a multicast address for a 

destination and each router maintains group membership lists 
for each interface that it is connected to and will forward 
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packets across the Internet to other routers such that all 
Users within the global group eventually receive a copy of 
the packet. Unless and until all routers within the Internet 
understand multicasting in this way, it is necessary to 
5 supplement it with IP tunneling in which multicast packets 
are encapsulated in unicast packets and routed by unicast 
routers to a multicast routers. The present invention can 
and will be able to take advantage of IP multicasting as it 
becomes widely available. Each channel of information would 

10 be given its own class D address and the Media Server would 
then simply transmit packets using the appropriate IP 
destination address. In this case no Media Servers would be 
used as this function would be accomplished by the routers in 
use to store and forward other IP packets. 

15 ^ Thus it can be appreciated that the implementation 

of the multicast delivery structure can be implemented using 
a combination of IP unicast, IP multicast and hardware 
multicast or any other system which provides for distributed 
delivery of information to a specific group of destinations. 

2 0 It is expected that special relationships with Internet 

providers will be established so that delivery of the audio 
steams can take place with a guaranteed bandwidth and in the 
most efficient way possible. 

In the preferred embodiment, packets of information 
25 for distribution use the UDP protocol under IP rather than 
the TCP protocol. TCP provides for reliable stream delivery 
but at the cost of retransmission and delays. For real-time 
information, it is usually more appropriate to use UDP since 
the information is time critical and low latency is more 

3 0 important that reliability. Since TCP is a point-to-point 

protocol, it is incompatible with IP multicasting. However, 
TCP could be used on the IP unicast links between Media 
Servers which are expected to have very low packet loss. In 
order to handle out of order, lost, duplicate and corrupted 
35 packets, the UDP packets are serialized. 

In the preferred embodiment the size of the audio 
packets being transmitted is variable and can change on a 
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packet by packet basis. It is expected that when using 
compression schemes that have a fixed bit rate, such as 
ADPCM, all packets for that stream would be the same size. 
Alternatively when using a variable bit rate compression 
5 algorithm, it is expected that packet size would vary so as 
to establish approximately the same amount of time for each 
sample. For example, if each packet corresponds to a 20 
millisecond segment of speech, this could correspond to 100 
bytes during one time period and 200 bytes during another. 
10 Additionally, the Media Server may choose to dynamically vary 
the packet size to accommodate changes in network conditions. 
Since the resultina Dlavbar.ic r,f ^* 

- _i • xiii wi lUCl L--LLJX1 

is sensitive to packet loss and network congestion, software 
running on the various computers which make up this system 
15 monitor the ongoing situation and adapt to it in the best 

possible way. This may involve using different Media Servers 
and/or lowering the data rate to the User. For example, 
similar to analog dynamic signal quality negotiation present 
in many analog radio receivers, the User software may request 
20 a lower bitrate until the situation is improved. Also, note 
that the audio information being delivered to the User is 
preferably interleaved so that a contiguous segment of the 
audiostream is distributed for transmission over several 
packets. As a result, the loss of one packet is spread out 
25 over multiple audio samples and causes minimal degradation in 
audio. Advantageously, a small degree of redundancy may be 
incorporated within the audio stream to further guard against 
packet loss. 

Preferably, there are two bitrate options available 
30 to the user for audio delivery. These are approximately 
20Kbps for standard audio and approximately 56Kbps for high 
quality audio. Thus, a 28.8Kbps modem connection over an 
analog phone line is sufficient to listen to standard audio 
broadcasts. To listen to high quality audio, an ISDN 
35 connection to the Internet is required, or some other 

connection with greater than 56Kbps bandwidth. It should be 
appreciated that higher bandwidths are currently becoming 
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available to end Users. In particular the use of cable 
modems and residential fiber networks are enhancing the 
bandwidths available to Users and thus making broadcasts of 
higher bitrates more practical. 
5 In addition to the content of the audio channel 

being delivered, it is also possible to deliver out of band 
of side-bar information such as graphics, images and text. 
This side-bar information is synchronized with the audio 
channel. This may only involve small increases in bandwidth 
10 requirements, such as l-2Kbps. For example a music program 
could deliver images of an album cover, the text of song 
lyrics, or URLs for use by a Web browser. The User can 
preferably choose to have the side-bar information show up 
automatically or be hidden. It is also possible to 

15 incorporate two-way interaction into the system, such that 
for example Users can participate in a global chat session 
during the audio broadcast. These and other details are 
explained in more detail below under the description of the 
User interface. 

20 The delivery of paid commercial advertising 

information is an important aspect of the present invention. 
Advertising may be incorporated into the audio stream within 
the Network Control Center as described above. It may also 
be incorporated into the audio stream at the User level, or 

25 at some intermediate point in the distribution architecture. 
In addition, the side-bar information discussed above can 
also include advertising content. Fig. 5 illustrates the 
provision to the User of two separate streams 32, 34 of 
packets, one of which may be used for advertising, in this 

30 case the insertion of the stream of commercial advertising 
into the non-commercial stream occurs on the User's computer. 
Fig. 5 also illustrates packet stream 36 which identifies 
the User to the system. This enables the system to monitor 
which Users are listening to which channels and also allows 

35 the system to vary, for example, the advertising content 
delivered to a User. 
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One advantage of this alternative is to allow 
targeted commercial delivery based on the individual User. 
That is, an individual User would receive the main audio feed 
plus a particular advertising stream unique to his 
5 demographic group. Note that the advertising stream 

typically is lower in overall bitrate and generally does not 
require real-time delivery, thus lowering the overall load on 
the network. For example, the advertising stream could be 
delivered to the User in advance of the regular programming, 
10 stored in a buffer in the User's computer and inserted into 
the stream of regular programming upon receipt of a cueing 
signal embedded in the stream of 

a substantial number of targeted groups, perhaps 10 or 100 or 
even more could be accommodated without an impractical 
15 increase in network load. 

II. Control Architecture 

The control architecture described in this section 
is responsible for managing and administering the Users who 

2 0 are receiving the information being delivered by the 

distribution architecture described in the previous section. 
The control architecture handles new User registration, User 
login, the starting and stopping of audio streams and the 
monitoring of ongoing transmissions. The control 

25 architecture is scalable just as is the distribution 

architecture so that any number of Users can be managed. 

This section describes the control protocol, which 
consists of the format and sequence of control messages that 
are exchanged among Users, Control Servers, Media Servers, 

30 Primary Servers and the Administration Server. These 

messages are in the form of objects, which have specific data 
formats. Objects are exchanged preferably using the TCP 
protocol although other options are possible. Below we 
describe the sequence of objects passed among the various 

35 computers and detail the internal structure of each object. 
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The major objects used in the present embodiment of 
the invention are set forth in Table l. For each object, 
Table 1 provides a brief description of its function, 
identification of the names of the fields in the object, 
5 their types and a brief description of their function. 

TABLE 1 

Channel Activation Object 

10 Contains information used for channel activation! deactivation. It is sent 

to Media and Primary Servers to tell them to carry or stop carrying a 
specific channel. Media Servers get the channel from another server in 
the system hierarchy and Primary Servers get and encode the feed from 

the actual input so urce. 

Field Name Field Type Remarks " 

15 Token Security Token Object 
Moniker Moniker Object 
Activate Int 
CompressType Int 
Host Host Object 



20 


Channel Guide Object 






Contains analytical and descriptive information for an item requested 
that is uniquely identified by a moniker. It is usually the reply to a 
Channel Guide Request object. 




Field Name 


Field Type Remarks 


25 


Token 

Type 

Result 


Security Token Object 

Int type of content 

the content data itself 










Channel Guide Request Object 




30 


Conveys a request for analytical and descriptive information about an 
item uniquely identified by the contained moniker. The reply is in the 
form of a Channel Guide object. 




Field Name 


Field Type Remarks 


35 


Token 

Type 

Moniker 


Security Token Object inherited from base class 
Inl type of content 
Moniker Object unique identifier 



unique channel identifier 
action flag (activate/deactivate) 
type of compression to use 
host carrying the channel 
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Table I (continued) 



Host Object 



Encapsulates the attributes of a networked computer related to the 
operation or services it offers or requests. 



Field Name 

Token 

HostName 

PortNumber 

DisplayName 



10 



Login Information Object 



Field Type 

Security Token Object 

String 

Int 

String 



Remarks 



computer name and domain 
port number for service 
descriptive computer name 



Encapsulates the name and password by which a User is known to the 
system. 



IS 



Field Name 

Token 
Login 
Password 



Field Type 



Remarks 



Security Token Object 

Strin S User's system login name 

Strin S User's system password (possibly 

____ encrypted) 



20 



Media Control Interface (MCI) Request Object ~ ~ 

Encapsulates a multimedia control command, such as play and stop, and 
any extra information that may be necessary to perform the requested 
service. 



25 



Field Name 

Token 

Command 

Siring 



Field Type 

Security Token Object 
Int 

String 



Remarks 



multimedia command 
command-specific extra info 



Moniker Object 



30 



A moniker encapsulates the name of an object or process with the 
intelligence necessary to work with that name. In other words, it 
provides naming and binding services. The Moniker Object is used in 
the system for unique identification of various components, parts or 
features, such as a channel, a directory, o r a computer list. 
Field Name 



35 



Token 
ID 

DisplayName 



Field Type 

Security Token Object 

String 

String 



Remarks 



unique string identifier 
User-readable name 
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Table 1 (continued) 

Ping Object 

Ping is the name given to the "Are-You- Alive?" operation useful in 
determining if a specific computer is up and running. This object is 
used in the system when a server has to be queried for its operational 
status. It can also provide timing information for statistical purposes 
and quality of service evaluations. 



10 



Field Name 


Field Type Remarks 


Token 


Security Token Object 


Date 


Date system date 


Time 


Time system time 




Protocol List Object 




Encapsulates a general purpose collection object. 


Field Name 


Field Type Remarks 


Token 


Security Token Object 


Type 


Int type of object list 





Result Message Object 



Acts as the acknowledgment for a requested service successfully carried 
that out or reports errors that occur in the system during a client/server 
transaction. 





Field Name 


Field Type 


Remarks 




Token 


Security Token Object 




25 


Code 


Im 


result code 




Message 


String 


message corresponding to code 



Security Token Object 



Contains the authorization key for a transaction. The key must be 

validated before any service is performed. 

Field Name Field Type Remarks 

ID String authorization key /transaction ID. 



35 
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Table I (continued) 



Server Activation Object 



Contains information used in the server activation/ deactivation process. 
Used for announcement as well as command purposes (e.g., a server can 
notify the administration database that is now activated or a server can 
be instructed to manage someone else). 



10 



Field Name 

Token 
Active 
Manage 
Type 
Host 



Field Type 

Security Token Object 

Int 

Int 

Int 

Host Object 



Remarks 



action flag (activate/deactivate) 
control flag (manage/associate) 
server type 
host to be controlled 



server List Request Object 



15 



Encapsulates a request for a list of available server resources for an 
identified service (e.g., a request for a list of Control Servers for a 
specified channel). 



20 



Field Name 

Token 
Type 
Moniker 
Host 



Field Type 

Security Token Object 
Int 

Moniker Object 
Host Object 



Remarks 



type of service 

content/channel unique identifier 
local host information 



Statistics Object 



25 



Contains system-related information that can be used by load- 
balancing algorithms and for statistical purposes. 



Field Name 



Field Type 



Remarks 



30 



Token 

Load 

Threads 

Users 

Uptime 

NumberManaged 
NumberAssociated 



Security Token Object 

Int 

Int 

Int 

Int 

Int 

Int 



load on the system 
number of threads running 
number of Users being 
serviced 

amount of time running 
number of managed servers 
number of associated servers 



35 



- 18 - 



WO 97/42582 



PCT/US97/07893 



Statistics Request Object 



Encapsulates a request for system-related information that can be used 
by load-balancing algorithms and statistical purposes. 



5 



Field Name 


Field Type 


Remarks 


Token 

Load 

Threads 

Users 

Uptime 

NumberManaged 
NumberAssociated 


Security Token Object 

Int 

Int 

Int 

Int 

Int 

Int 


request flag (on/off) 
request flag (on/off) 
request flag (on/off) 
request flag (on/off) 
request flag (on/off) 
request flag (on/off) 



User Object 



Users and Servers use this object to register themselves with the 
administration database. They provide the information for subsequent 
logins (name, password) and other system-related info. The end-Users 

15 provide personal, demographic, and system-relate d information. 

Field Name Field Type Remarks 



25 



Token 


Security Token Object 




Login 


Login Information Object 


login information(name, password) 


FirstName 


String 


User's first name 


LastName 


String 


User's last name 


Title 


String 


User's job title 


Company 


String 


User's employer 


Address! 


String 


User's home street address 


Address2 


String 


User's address extra 


City 


String 


city, village 


State 


String 


state, province or foreign country 


ZipCode 


String 


zip or postal code 


Age 


String 


User's age 


Gender 


String 


User's gender 


PhoneNumber 


String 


telephone number 


FaxNumber 


String 


fax number 


Email 


String 


email address 


Demographics 


Dictionary 


market-targeting extra User info 


Systemlnfo 


Dictionary 


system-related information 



35 
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Table J (continued) 



Version Object 



All components of the system use this object to report their versioning 
information to the party they transact with in order to use a protocol 
they both understand. They are also given the chance to update 
themselves if a newer version exists. 
Field Name Field Type Remarks 



10 



Token Security Token Object 

Major im 

Minor i n t 

Type int 



major protocol version number 
minor protocol version number 
sender type 



Client Version client version information 



ITr> 1 il>o 4--* — . ^1 -I ■*- -: _ *i _. j 

^uux>.j.uiia± protocols oasea on state 
computers, the control protocol of the present invention is a 
light-weight, stateless protocol comprising simple sequences 

15 of objects. It is light-weight in that in most sequences 
only two objects are involved in the transaction and after a 
sequence is completed the connection can be reused. It is 
also stateless in that the server maintains no information 
about the client. Every transaction is handled independently 

20 of the previous ones. States exist in the lower levels, for 
example within the TCP layer, to express logical states of a 
network connection but they are not actually part of the 
control protocol. 

In the preferred embodiment, the software running 
25 on the Control Servers, Media Servers and Primary Servers is 
programmed for Windows NT and UNIX environment using the OLE 
environment. In addition, COM interfaces are used between 
components. The Rogue Wave system is used to transfer 
objects between the applications running on the various 
30 computers. The software running on the User computer is 

preferably programmed for a Windows 32-bit environment, so it 
will run on a Windows 95 or Windows NT computer. 
Alternatively, Macintosh and UNIX environments can be 
accommodated by other User software. 

35 

The basic process of a control transaction consists 
of a version sequence followed by one or more protocol 
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sequences. The version sequence starts after the computer 
initiating the transaction, the client, has established a 
connection with the computer completing the transaction, the 
server. The client sends a Version Object (defined in Table 
5 l) and in response the server then sends back its own Version 
Object. This version sequence is used so that both client 
and server are aware of the version numbers of the software 
they are using. If a version number is older than expected, 
either client or server can choose to conform to the previous 

10 version or abort the transaction, depending on its needs and 
capabilities. If a version number is newer than expected, in 
most cases the current transaction can be completed since the 
software systems are designed to be fully backward compatible 
with previous versions. Additionally, in the case that the 

15 server of the transaction is the Administration Server, the 
client receives information about what the latest version 
number is and thus the client can be informed that a software 
update is needed. The process of handling automatic updating 
of User software is described more fully below. 

20 After the version sequence, one or more protocol 

sequences occur in which other objects are exchanged between 
client and server. When a particular protocol sequence is 
completed, another independent protocol sequence can be 
serviced. The protocol sequences that are part of the 

25 control architecture of the present invention are summarized 
in Table 2 and described below in conjunction with Figures 6- 
17 . 
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TABLE 2 



Summary of Protocol Sequences 





Control Sequence 


|| Client 


Server 


Main Objects Exchanged 




5 


User Registration 
and Login 
(see Fig. 6) 


User 


Administration 


Version Object 

User Object 

Channel Guide Object 


10 


User Login 
(see Fig. 7) 


User 


Administration 


Version Object 

Login Information Object 

Channel Guide Object 




1 T\l 

Liiaiuici nay 
(see Figs 8a, 8B, 
8C) 


user 


Administration 


Version Object 
Server List Object 




15 






Control 


Version Object 
Server List Object 




20 






Media 


Version Object 
MCI Objects - 
OPEN/PLAY/STOP/CLOSE 
Ping Objects 

(TCP connection stays open) 






Token Validation 
(see Figs. 9A, 
9B) 


Control or 
Media or 
Primary 


Administration or 
Control 


Version Object 
Security Token Object 


25 


Server 

Registration and 
Login 

(see Fig. 10) 


Media or 
Control 


Administration 


Version Object 

User Object 

Server Activation Object 


30 


Server Login 
(see Fie. 11) 


Media or 
Control 


Administration 


Version Object 

Login Object 

Server Activation Object 




Control Server 
Activation 
(see Fig. 12) 


Administration 


Control 


Version Object 

Server Activation Object 



35 
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5 



15 



20 



Control Sequence 


Client 


Server 


Main Objects Exchanged 


Media Server 
Activation 
(see Fig. 13) 


Control 


Media 


Version Object 

Sprvpr Ar'tivafinn Ohiecf 

Ping Objects 

(TCP connection stays open) 


Control Channel 
Activation 
(see Fig. 14) 


Administration 


Control 


X/prcinn Ohif*rt 

Channel Activation Object 


Media Channel 
Aciivation 
(see Fig. 15) 


Control 


Media 


Channel Activation Objects 


Distribution 
Activation 
(see Fie. 16) 


Media 


Media or 
Primary 


Version Object 
MCI Objects - 
OPEN/PLAY/STOP/CI 0<>F 
Ping Objects 

(TCP connection stays open) 


Statistics Request 
(see Fig. 17) 


Administration 


Control or 
Media 


Version Object 
Statistics Object 



The User registration and login sequences are the 
processes by which a new User registers with the system, logs 
in and retrieves programming information. The channel play 
sequence takes place when a User asks to listen to a 
particular channel. The token validation sequence is used to 
verify that a computer requesting a service is authorized to 
do so. The Server registration, login and activation 
sequences are used by Control and Media Servers when they 
become active. The Control Server and Media Server 
activation sequences are used to manage the Control and Media 
Servers. The control channel, media channel and distribution 
activation sequences are used to cause a channel to be 
distributed to a Media Server. Finally, the statistics 
request is used for administrative purposes. 
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Fig. 6 illustrates the User registration and login 
sequence in more detail. This sequence takes place after the 
User has installed the User software on his/her computer. It 
is expected that the User will download the software from the 
5 Internet and then invoke it which in the preferred embodiment 
will use the Windows Wizard interface. This will guide the 
User through the installation process including filling out 
the registration form, which we. will describe more fully in 
the next section. After the User has selected a name and 
10 password and selected the option to register, the User 

computer opens a TCP connection to the Administration Server. 
Advantageously, the full domain name nf iH»^i^,^- 
Server is embedded into the User software, although it could 
be discovered in other ways. The User and Administration 
15 Server then exchange version objects with the Administration 
Server as described above. If the version numbers meet 
expectations, the User sends a User Object to the 
Administration Server. The format of the User Object is 
shown in Table 1. Once the Administration Server receives 
20 the User Object, it verifies that the information is filled 
in properly and that the selected User name is unique. If 
the User Object is invalid for any reason, the Administration 
Server returns a Result Message Object with a code indicating 
the reason. The format of the Result Message Object is shown 
25 in Table l. If the User information is valid, the 

Administration Server updates the global database of User 
names and passwords and then generates a security token for 
that User. This security token is then returned to the User 
in a Result Message Object. 
30 Upon receiving the Result Message Object, the User 

saves the security token for future use. This token is an 
identifier that allows the User to request services from the 
Administration Server and other computers within the overall 
system. The security token is not saved permanently or 
35 registered on the User computer. Normally, the User software 
then immediately sends a Channel Guide Request Object to the 
Administration Server and a Channel Guide Object is returned. 
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The format of these objects is also shown in Table 1. Note 
that in principle, this is a separate transaction and could 
take place in a separate TCP connection to the Administration 
Server. In particular, once the User has registered and 
5 logged in, he/she can request the Channel Guide Object again 
since it may have been updated since the previous request. 
At this point the TCP connection to the Administration server 
is closed. 

The process of User registration only needs to take 
10 place once for each User. However anyone can re-register at 
any time, even after the software has been installed. In 
particular, it is expected that if multiple persons use a 
computer, each person will register and obtain his/her own 
User name and password. If the registration process is not 

15 completed successfully, the User software saves the 

registration information and ask the User if they would like 
to try again the next time the software is invoked. 

Since the security token is not permanently saved 
by the User software, it is lost when the User software is 

20 closed, and the security token must again be retrieved from 
the Administration Server the next time the User wants to use 
the system. This process is the purpose of the login 
sequence illustrated in Fig. 7. This sequence is used if a 
User has already registered and needs only to retrieve a 

25 valid security token. In this case the sequence consists of 
the User's sending a Login Information Object to the 
Administration Server. The Administration Server then 
queries the User database to validate the login name and 
password. If the login name and password are correct, then a 

3 0 security token is returned to the User. Normally the receipt 
of the security token will immediately be followed by a 
channel information request sequence, just as in the 
registration sequence described previously. 

The control sequence that takes place when a User 

35 initiates a channel play operation is illustrated in Figs. 
8A, 8B and 8C. First the User software requests a Control 
Server List from the Administration Server. Note that the 
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Server List Request Object, illustrated in Table l contains a 
channel identifier. The Administration Server generates a 
sorted list of Control Servers based on overall system load 
and the location of the User on the network and returns this 
5 list to the User using a Protocol List Object. Once the 
Control Server List is returned to the User, the 
Administration Server is no longer needed and the TCP 
connection is closed. 

The User software then searches the list of Control 
10 Servers and opens a TCP connection to the first host listed. 
If that host computer does not respond, then the next Control 
Server on the list is tested and so forth in succession. 
Upon obtaining a response from a Control Server, the User 
software uses a Server List Request Object to requests a 
15 Media Server List from the Control Server. If the Control 
Server is too busy to service the User, it returns a Result 
Message Object so indicating and the User software tries the 
next Control Server on the list. However, in the likely 
scenario that the Control Server is able to handle the User's 
20 request, a sorted list of Media Servers is generated and 
returned to the User computer using a Protocol List Object. 
The TCP connection to the Control Server is then closed by 
the User software. 

At this point the User software initiates a TCP 
25 connection to the first Media Server on the list provided by 
the Control Server. As in the previous case, it attempts to 
connect to the first host on the list and if unsuccessful 
tries the next hosts in succession. Once the Version Objects 
are exchanged, the User software sends an MCI Request Object 
30 to the Media Server. An MCI Request Object can be used for 
four basic commands: OPEN, PLAY, STOP and CLOSE. The User 
software must first send an OPEN command for the desired 
channel. if the returned Result Message Object indicates 
success, the User software then sends a PLAY command. 
35 When the Media Server receives a valid PLAY 

command, it initiates the delivery of audio information to 
the User as described in the previous section. Note that 



- 26 - 



WO 97/42582 



PCT/US97/07893 



this could be in the form of broadcast, multicast or unicast 
packets to a specific UDP port. The TCP connection through 
which the MCI Request Objects were sent stays open during the 
audio play operation. In addition, Ping Objects are sent to 
5 the User on a periodic basis to verify that the computer is 
still working and active. When the User software receives a 
Ping Object, it simply returns it. The Media Server uses the 
Ping Objects to measure round trip time and also to determine 
when a User's computer has terminated abnormally. In that 

10 case the audio stream is terminated. 

In the case of normal termination of the audio 
stream, the User makes an explicit selection to stop and this 
causes a STOP command to be sent to the Media Server in an 
MCI Request Object. The Media Server then terminates the 

15 audio stream to that User. When the User closes the 

application software or selects another channel to play, the 
User software will send a CLOSE command to the Media Server 
in an MCI Request Object and the TCP connection is closed. 

The initiation of the audio stream by the Media 

20 Server causes a log entry to be generated and sent to the 

Administration Server. This information is important so that 
the Administration Server can update its database to indicate 
which Users are listening to which channels. The security 
token is used to identify the User initiating the audio 

25 stream. Additionally, when the audio stream is terminated to 
any User, another log message is generated and sent to the 
Administration Server. 

Fig. 9A illustrates the process by which security 
tokens are validated. The Administration Server is the only 

30 server that can validate a security token. Thus, when a User 
requests services from a Control Server or from a Media 
Server, that server must go back to the Administration Server 
with a token validation sequence. However, Control Servers 
and Media Servers are allowed to cache validations of 

35 security tokens so that they do not have to validate tokens 
repeatedly once they have validated it the first time. In 
the case where a Media Server receives a request, the token 
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will be validated with the Control Server that is managing 
that Media Server. Fig. 9B identifies the various token 
validation scenarios. 

Fig. 10 illustrates the process by which a new 
5 Server is registered. This process is similar to new User 
registration. It is expected, however, that the server 
installation will be through a Web interface rather than a 
Wizard. The Administration Server, upon receiving a User 
Object from a Media Server or Control Server validates the 
10 User name and password and generate a security token just as 
in the case of User registration. Normally the Server then 

immediately sends back a Server Activation nh-io^ 

that it is ready to be used as a system resource. Once this 
process has been completed, the TCP connection to the 
15 Administration Server is closed. 

If a Media Server or Control Server that has sent a 
Server Activation Object to the Administration Server becomes 
inactive, it will send another Server Activation Object 
indicating this condition. In the case of a Media Server, 
2 0 this object is sent to the managing Control Server. In the 
case of a Control Server, this object sent to the 
Administration Server. As in the case of User registration, 
Media Server and Control Server registration needs only take 
place once per computer. However, if the computer is 
25 restarted, the server must login and again retrieve a 
security token. This is the server login and activation 
sequence shown in Figure 11. 

Once a Control Server has indicated to the 
Administration Server that it is ready, the Administration 
30 Server can activate that Control Server by sending the 

Control Server a Server Activation Object as illustrated in 
Fig. 12. This is a separate transaction and is used to tell 
the Control Server which Media Servers it is supposed to 
manage. Recall that a Control Server and a number of Media 
35 Servers form a cluster of Media Servers. The single Control 
Server that manages that cluster must be given a list of host 
computers corresponding to the Media Servers in that cluster. 
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The process by which a Control Server activates the 
Media Servers that it manages is illustrated in Fig. 13. The 
Control Server sends a Server Activation Object to the Media 
Server indicating that it is responsible for channel 
5 management. This TCP connection between the Control Server 
and the Media Server stays open during the time that both 
servers are active. The Control Server periodically sends 
Ping Objects to the Media Server across this open TCP 
connection to verify that the Media Server is still running. 

10 Fig. 14 illustrates the process by which a given 

channel is activated by the Administration Server. The 
Administration Server opens a connection to a Control Server 
that its wishes to have carry a given channel and provide a 
Channel Activation Object. This object indicates to the 

15 Control Server which Media or Primary Server the Control 

Server should direct its Media Servers to get the feed from. 
At this point the Control Server is said to be carrying that 
channel and it will be a valid host on a list of Control 
Servers reguested by a Channel Play sequence. 

2 0 Fig. 15 illustrates what happens when a Control 

Server needs to provide a channel. First it sends a Channel 
Activation Object to one of the Media Servers that it manages 
across the open TCP connection described previously. This 
object indicates to the Media Server that it should start 

25 receiving the channel identified and from where it should 
receive it. 

In Figs. 16A and 16B depict how the Media Server 
requests distribution of an audio channel from another Media 
Server or from a Primary Server. This sequence is much the 

30 same as that in which a User requests the distribution of- 
audio information from a Media Server. Note that a Media 
Server receives a single incoming stream for each channel 
that it is carrying and will then redistributes this stream 
to all Users or other Media Servers that request it. 

35 Finally, Fig. 17 illustrates the statistics request 

sequence. This sequence is used by the Administration Server 
to gather information from the Media Servers and Control 
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Servers in order to manage the overall system. it can use 
this information to detect failures and to balance load as 
the dynamic conditions change. As indicated above, it can 
also use this information to monitor which Users are 
5 listening to which channel or whether Users stop listening to 
a channel at any time, such as during the play of a 
particular song. It can also use this information to control 
the advertising content that is. downloaded to a particular 
User in advance of receipt of regular audio programming 
10 and/or monitor the delivery of advertising to the Users. 

The control architecture described in this section 
is scalable to handle anv number nf iicorr vi^-i — 
User registration process only happens once for each 
subscriber and the login process only happens once per 
15 session. These interactions, which require the 

Administration Server are expected to constitute a very small 
percentage of the overall system bandwidth. If the 
Administration Server were to become a bottleneck, however, 
it would be possible to duplicate it and to have the database 
2 0 it maintains distributed and automatically updated to 
guarantee consistency. 

The Control Servers are distributed throughout the 
network and can handle the lower level interactions with the 
Users and the Media Servers. A single Control Server can 
25 handle preferably on the order of ten Media Servers up to 
several hundred Users. The bitrate among the Users, the 
Control Servers and the Media Servers is expected to be small 
in comparison to the audio transmission bitrate. The Ping 
Objects normally only involve the User and the nearest Media 
30 Server. They are also low in overhead since they are small 
and only get transmitted infrequently. 

III. User Interface 

The User interface is provided by the client application 
35 running on an individual computer and its associated 

graphical interface, m the preferred embodiment the User 
interface is available for 32-bit Windows (95 and NT) , 
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Macintosh and UNIX platforms. Preferably anyone on the 
Internet can freely download a copy of the client software 
and install it in their computer • 

Figure 18 illustrates the main User screen in the 
5 preferred embodiment. The screen is composed of three 
sections: channel guide (upper left frame) , program guide 
(upper right frame), and multimedia frame (lower half of 
screen) . The channel guide lists, as a tree hierarchy, the 
channels that are available from the system. The User 

10 selects a channel from the list of those displayed on the 
channel guide. The program guide provides information 
pertaining to the channel selected. This information can be 
a detailed schedule of the programming that has played or 
will be playing on the channel selected. Additionally, other 

15 relevant information will be displayed in this frame, for 
example, a notice regarding an upcoming special event on 
another channel. The multimedia frame provides an integrated 
web browser that displays information via a series of tabbed 
sections. 

20 The information contained in the channel guide, program 

guide, and the tabs of the multimedia frame is dynamically 
transmitted to the client. For example, if a new channel 
begins operation, the client application can immediately 
display it as being available. Furthermore, the tabs 

25 displayed can be specifically relevant depending on what song 
is playing. For example, tabs displaying the album cover, 
information on the artist, song lyrics, tour dates can be 
displayed. Additionally, as shown in the example in figure 
18, a tab can be available allowing the User to place an 

30 order for the CD or allowing the User to participate in a 
chat session related to the channel. 

Figure 19 illustrates the key pull-down menus available 
in the main User screen in the preferred embodiment. Table 3 
provides a description of each of the functions available 

35 through the pull down menus, as shown in figure 19. 



- 31 - 



WO 97/42582 



PCT/US97/07893 



As will be apparent to those skilled in the art, 
numerous modifications may be made within the spirit and 
scope of the invention. 

5 Table 3 



Pull-Down Menu Functions 





Menu 
Choice 


Menu Sub-Choice 


Description 




Pile 


Login 


Allows the User to login to 
the system. 


10 




Logout 


Allows the User to logout 
from the system. 






Register 


Brings up a dialog so that 

the 0^^"*" TV t r\yr r.rif k 

the system for the first 
time. 






Close 


Minimizes the screen. 


15 


Edit 


Copy 


Allows the User to copy the 
selection on to the 
clipboard. 






Properties 


Allows the User to set 
various properties. 




Audio 


Play 


Begins playing the selected 
channel . 


20 




Stop 


Stops playing the selected 
channel. 






Mute 


Stops the playing of audio 




View 


Tool Bar 


Display or hide the tool bar 
(providing access to pull- 
down menu functions) . 


25 




Status Bar 


Display or hide the status 
bar normally situated at 
bottom of the screen. 






Web Bar 


Display or hide the tool bar 
section that provides access 
to the web browser functions. 




Help 


Help Topics 


Brings up a list of available 
online help topics. 


30 




About . . . 


Displays summary infirmation 
regarding this application, 
such as version number, 
copyright information, and so 
on. 



35 
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What is claimed is: 

1. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/or 
5 visual information into a plurality of streams of addressed 
digital packets complying with the specifications of a 
network communication protocol, 

for each stream, routing such stream to one or more 

users, 

10 controlling the routing of the stream of packets in 

response to selection signals received from the users, and 
monitoring the reception of packets by the users 
and accumulating records which indicate which streams of 
packets were received by which users. 

15 

2. The method of claim 1 further comprising the step 
of including in at least one stream of packets at least some 
advertising information* 

20 3. The method of claim 2 further comprising the step 

of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided. 

25 4. The method of claim 2 wherein the advertising 

information is inserted into the stream of audio and/or 
visual information before such stream is converted into a 
stream of packets. 

30 5. The method of claim 1 further comprising the step 

of generating an audio output and/ or a visual display from 
the stream of packets received by the user. 

6. The method of claim l further comprising the steps 

35 of: 

storing a first stream of packets received by the 
user at a first time and 
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at a later time, inserting the first stream of 
packets into a second stream of packets received at the user. 

7. The method of claim 6 further comprising the step 
5 of converting the combined first and second streams of 

packets into an audio output and/ or visual display, 

8. The method of claim 6 .wherein the first stream of 
packets contains advertising information . 

10 

9. The method of claim 6 wherein the content of the 
advert is ma inf ormat 

— - „ — jp» wi * t~Xj.C; XUCll L-iU^ 

of the user. 

15 10. The method of claim 2 wherein the records that are 

accumulated indicate how many users received specific 
advertising information . 

11. The method of claim l wherein at least one stream 
20 of packets comprises copyrighted music selections and the 

records that are accumulated indicate how many users received 
specific music selections. 

12. The. method of claim 1 wherein at least one stream 
25 of packets comprise music selections and the records that are 

accumulated" indicate how many users did or did not listen to 
the entire selection. 

13. The method of claim 1 further comprising the steps 

30 of: 

compressing the stream of packets in their passage 
from source to user, and 

decompressing the stream of packets near the user. 

35 14. The method of claim 3 where in the compressing step 

uses a compression algorithm that is selected in accordance 
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with the content of the information being communicated in the 
stream of packets, 

15. The method of claim 4 wherein the compressing step 
5 inserts into each packet an identification of the compression 
algorithm used and the decompressing step monitors each 
packet to read such identification and to vary its 
decompression algorithm in resppnse thereto. 

10 16. A method for transmitting at least one stream of 

audio and/ or visual information over a communications network 
to a plurality of users comprising the steps of: 

controlling the routing of the stream of 
information through the network in response to selection 
15 signals received from the users, and 

monitoring the reception of the stream of 
information by the users and accumulating records relating to 
the reception of the stream of information by the users. 

20 17. The method of claim 16 further comprising the step 

of including in at least one stream of information at least 
some advertising information. 

18. The method of claim 17 further comprising the step 
25 of varying the content of the advertising information with 

the identity of the user to whom the advertising information 
is provided • 

19. The method of claim 16 further comprising the steps 

30 of: 

storing a first stream of information received by 
the user at a first time and 

at a later time, inserting the first stream of 
information into a second stream of information received by 
35 the user. 



- 35 - 



WO 97/42582 



PCT/US97/07893 



20. The method of claim 19 wherein the first stream of 
information contains advertising information. 

21. The method of claim 17 wherein the records that are 
5 accumulated indicate how many users received specific 

advertising information. 

22. The method of claim 17. wherein at least one stream 
Of packets comprises copyrighted music selections and the 

10 records that are accumulated indicate how many users received 
specific music selections. 

23. The method of claim 17 wherein at least one stream 
of packets comprise music selections and the records- that are 

15 accumulated indicate how many users did or did not listen to 
the entire selection. 

24. The method of claim 17 further comprising the steps 

of: 

20 compressing the stream of information in its 

passage from source to user, and 

decompressing the stream of information near the 

user. 



25. The method of claim 24 wherein the compressing step 
uses a compression algorithm that is selected in accordance 
with the consent of the information being communicated in the 
stream of information. 

26 • The method of claim 16 wherein multiple streams of 
audio and/or visual information are transmitted over the 
communications network and the user can select which stream 
to receive. 



35 27. A communication system comprising: 

means for converting at least one stream of audio 
and/or visual information into a stream of addressed digital 
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packets complying with the specifications of a network 
communication protocol, 

means for routing such stream via a communication 
network to selected users, 
5 means for controlling the routing of the stream of 

packets in response to selection signals received from the 
users, and 

means for monitoring the reception of packets by 
the user and for accumulating records which indicate which 
10 streams of packets were received by which users. 

28. The communication system of claim 27 further 
comprising means for including in the stream of packets at 
least some advertising information. 

15 

29. The communication system of claim 28 further 
comprising means for varying the content of the advertising 
information with the identity of the user to whom the 
advertising information is provided. 

20 

30. The communication system of claim 27 further 
comprising means for generating from the stream of packets 
received at the user an audio output and/or a visual display. 

- 5 31. The communication system of claim 27 further 

comprising means for storing packets received at the user 
during a first time period and means for inserting such 
packets into other packets received at the user at a later 
time period. 

10 

32. The communication system of claim 31 wherein the 
stream of packets received during the first time period 
contains advertising information. 

i5 33. The communication system of claim 32 wherein the 

content of the advertising information is varied depending on 
the identity of the user. 



- 37 - 



WO 97/42582 



PCT/US97/07893 



34. The communication system of claim 27 further 
comprising: 

means for compressing the stream of packets in 
their passage from source to user, and 
5 downstream of the compressing means, means for 

decompressing the stream of packets. 

35. The communication system of claim 34 wherein the 
compressing means is located near the converting means and 

10 the decompressing means is located at the user. 

36. The communication qvctom ^-f i ^ -; ™ ~> a t — -: ~ 

- .„ — j. — w.i.m.j^mi _» -r WiiciC±il LilC 

compressing means uses a compression algorithm that is 
selected in accordance with the content of the information 
15 being communicated in the stream of packets. 

37. The communication system of claim 34 wherein the 
compressing means inserts into each packet an identification 
of the compression algorithm used and the decompressing means 

20 monitors each packet to read such identification and to vary 
its decompression algorithm in response thereto. 



25 



30 



35 
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AMENDED CLAIMS 

[received by the International Bureau on 24 November 1997 (24.11.97); 
original claims 1, 12, 14-16, 22, 23 and 27 amended; new claims 38-51 added; 
remaining claims unchanged (10 pages)] 

1. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/ or 
5 visual information into a plurality of streams of addressed 
digital packets complying with the specifications of a 
network communication protocol, 

for each stream, routing such stream to one or more 

users, 

10 controlling the routing of the stream of packets in 

response to selection signals received from the users, and 
monitoring the reception of packets by the users 
and accumulating records that indicate which streams of 
packets were received by which users, wherein at least one 

15 stream of packets comprises an audio and/ or visual selection 
and the records that are accumulated indicate the time that a 
user starts receiving the audio and/or visual selection and 
the time that the user stops receiving the audio and/ or 
visual selection « 

20 

2. The method of claim 1 further comprising the step 
of including in at least one stream of packets at least some 
advertising information. 

25 3 - The method of claim 2 further comprising the step 

of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided. 



4 . The method of claim 2 wherein the advertising 
information is inserted into the stream of audio and/ or 
visual information before such stream is converted into a 
stream of packets. 

5. The method of claim 1 further comprising the step 
of generating an audio output and/or a visual display from 
the stream of packets received by the user. 
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Of 



6. The method of claim 1 further comprising the steps 



storing a first stream of packets received by the 
user at a first time and 

5 at a later time, inserting the first stream of 

packets into a second stream of packets received at the user, 

7. The method of claim 6>further comprising the step 
of converting the combined first and second streams of 
10 packets into an audio output and/or visual display. 

WJ - l - iai « l ° wnerem tne first stream of 



packets contains advertising informati 



on. 



15 9. The method of claim 6 wherein the content of the 

advertising information is varied depending on the identity 
of the user. 

10. The method of claim 2 wherein the records that are 
20 accumulated indicate how many users received specific 

advertising information. 

11. The method of claim 1 wherein at least one stream 
of packets comprises copyrighted music selections and the 

25 records that are accumulated indicate how many users received 
specific music selections. 

12. The method of claim 1 wherein at least one stream 
of packets comprises music selections and the records that 

30 are accumulated indicate how many users did or did not listen 
to the entire selection. 

13. The method of claim l further comprising the steps 

of: 

35 compressing the stream of packets in their passage 

from source to user, and 

decompressing the stream of packets near the user. 
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14. The method of claim 13 wherein the compressing step 
uses a compression algorithm that is selected in accordance 
with the content of the information being communicated in the 
stream of packets. 

5 

15. The method of claim 14 wherein the compressing step 
inserts into each packet an identification of the compression 
algorithm used and the decompressing step monitors each 
packet to read such identification and to vary its 

10 decompression algorithm in response thereto. 

16. A method for transmitting at least one stream of 
audio and/ or visual information over a communications network 
to a plurality of users comprising the steps of: 

15 controlling the routing of the stream of 

information through the network in response to selection 
signals received from the users, and 

monitoring the reception of the stream of 
information by the users and accumulating records relating to 

2 0 the reception of the stream of information by the users, 

wherein at least one stream of information comprises an audio 
and/ or visual selection and the records that are accumulated 
indicate the time that a user starts receiving the audio 
and/or visual selection and the time that the user stops 

25 receiving the audio and/or visual selection. 

17. The method of claim 16 further comprising the step 
of including in at least one stream of information at least 
some advertising information. 

30 

18. The method of claim 17 further comprising the step 
of varying the content of the advertising information with 
the identity of the user to whom the advertising information 
is provided. 

35 

19. The method of claim 16 further comprising the steps 

of: 
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storing a first stream of information received by 
the user at a first time and 

at a later time, inserting the first stream of 
information into a second stream of information received by 
5 the user. 



20. The method of claim 19 wherein the first stream of 
information contains advertising information. 

21. The method of claim 17 wherein the records that an 
accumulated indicate how many users received specific 



22. The method of claim 17 wherein at least one stream 
of information comprises copyrighted music selections and the 
records that are accumulated indicate how many users received 
specific music selections. 



23. The method of claim 17 wherein at least one stream 
20 of information comprises music selections and the records 

that are accumulated' indicate how many users did or did not 
listen to the entire selection. 

24. The method of claim 17 further comprising the steps 

25 of: 

compressing the stream of information in its 
passage from source to user, and 

decompressing the stream of information near the 

user. 

30 

25. The method of claim 24 wherein the compressing step 
uses a compression algorithm that is selected in accordance 
with the content of the information being communicated in the 
stream of information. 

35 

26. The method of claim 16 wherein multiple streams of 
audio and/ or visual information are transmitted over the 
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communications network and the user can select which stream 
to receive. 

27. A communication system comprising: 

5 means for converting at least one stream of audio 

and/or visual information into a stream of addressed digital 
packets complying with the specifications of a network 
communication protocol, 

means for routing such stream via a communication 
10 network to selected users, 

means for controlling the routing of the stream of 
packets in response to selection signals received from the 
users, and 

means for monitoring the reception of packets by 
15 the user and for accumulating records that indicate which 
streams of packets were received by which users, wherein at 
least one stream of packets comprises an audio and/ or visual 
selection, and the means for monitoring further includes 
means for accumulating records that indicate the time that a 
20 user starts receiving the audio and/ or visual selection and 
the time that the user stops receiving the audio and/ or 
visual selection. 

28. The communication system of claim 27 further 

25 comprising means for including in the stream of packets at 
least some advertising information. 

29. The communication system of claim 28 further 
comprising means for varying the content of the advertising 

30 information with the identity of the user to whom the 
advertising information is provided. 

30. The communication system of claim 27 further 
comprising means for generating from the stream of packets 

35 received at the user an audio output and/or a visual display. 
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31. The communication system of claim 27 further 
comprising means for storing packets received at the user 
during a first time period and means for inserting such 
packets into other packets received at the user at a later 

5 time period. 

32. The communication system of claim 31 wherein the 
stream of packets received during the first time period 
contains advertising information. 

10 

33. The communication system of claim 32 wherein the 
content of the advertising information is varied depending on 
the identity of the user. 

15 34 • Tne communication system of claim 27 further 

comprising: 

means for compressing the stream of packets in 
their passage from source to user, and 

downstream of the compressing means, means for 
2 0 decompressing the stream of packets. 

35. The communication system of claim 34 wherein the 
compressing means is located near the converting means and 
the decompressing means is located at the user. 

25 

36. The communication system of claim 34 wherein the 
compressing means uses a compression algorithm that is 
selected in accordance with the content of the information 
being communicated in the stream of packets. 

30 

37. The communication system of claim 34 wherein the 
compressing means inserts into each packet an identification 
of the compression algorithm used and the decompressing means 
monitors each packet to read such identification and to vary 

35 its decompression algorithm in response thereto. 
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38. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/or 
visual information into a plurality of streams of addressed 
5 digital packets complying with the specifications of a 
network communication protocol, 

for each stream, routing such stream to one or more 

users, 

controlling the routing of the stream of packets in 
10 response to selection signals received from the users, and 
monitoring the reception of packets by the users 
and accumulating records that indicate which streams of 
packets were received by which users, wherein at least one 
stream of packets comprises music selections and the records 
15 that are accumulated indicate how many users did or did not 
listen to the entire selection. 

39. A method for transmitting at least one stream of 
audio and/or visual information over a communications network 

20 to a plurality of users comprising the steps of: 

controlling the routing of the stream of 
information through the network in response to selection 
signals received from the users, and 

monitoring the reception of the stream of 

25 information by the users and accumulating records relating to 
the reception of the stream of information by the users, 
wherein at least one stream of information comprises music 
selections and the records that are accumulated indicate how 
many users did or did not listen to the entire selection. 

30 

40. A method for transmitting message packets over a 
communications network comprising the steps of: 

converting a plurality of streams of audio and/or 
visual information into a plurality of streams of addressed 
35 digital packets complying with the specifications of a 
network communication protocol, 
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for each stream, routing such stream to one or more 

users, 

controlling the routing of the stream of packets in 
response to selection signals received from the users, and 
5 monitoring the reception of packets by the users 

and accumulating records that indicate which streams of 
packets were received by which users, wherein at least one 
stream of packets comprises an *audio and/ or visual selection 
and the records that are accumulated indicate the elapsed 
10 time that a user received the audio and/or visual selection. 

— ~ „.ww~w~ Liansiuitting at least one stream of 

audio and/or visual information over a communications network 
to a plurality of users comprising the steps of: 

15 controlling the routing of the stream of 

information through the network in response to selection 
signals received from the users, and 

monitoring the reception of the stream of 
information by the users and accumulating records relating to 

20 the reception of the stream of information by the users, 

wherein at least one stream of information comprises an audio 
and/or visual selection and the records that are accumulated 
indicate the elapsed time that a user received the audio 
and/or visual selection. 

25 

42. A communication system comprising: 

means for converting at least one stream of audio 
and/or visual information into a stream of addressed digital 
packets complying with the specifications of a network 
30 communication protocol, 

means for routing such stream via a communication 
network to selected users, 

means for controlling the routing of the stream of 
packets in response to selection signals received from the 
35 users, and 

means for monitoring the reception of packets by 
the user and for accumulating records that indicate which 
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streams of packets were received by which users, wherein at 
least one stream of packets comprises an audio and/or visual 
selection, and the means for monitoring further includes 
means for accumulating records that indicate the elapsed time 
5 that a user received the audio and/ or visual selection. 

43. The method of claim 2 wherein the records that are 
accumulated indicate which users received specific 
advertising information. 

10 

44. The method of claim l wherein at least one stream 
of packets comprises copyrighted music selections and the 
records that are accumulated indicate which users received 
specific music selections. 

15 

45. The method of claim 17 wherein the records that are 
accumulated indicate which users received specific 
advertising information. 

20 46. The method of claim 16 wherein at least one stream 

of information comprises copyrighted music selections and the 
records that are accumulated indicate which users received 
specific music selections. 

25 47 • Tne communication system of claim 28 wherein the 

means for monitoring further accumulates records that 
indicate which users received specific advertising 
information. 



30 48 • The communication system of claim 27 wherein at 

least one stream of packets comprises copyrighted music 
selections and the means for monitoring further accumulates 
records that indicate which users received specific music 
selections. 



35 



49. The method of claim 1 further comprising the steps 

of: 
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storing a first stream of packets received by the user 

at a first time and 

inserting the first strean, of packets into a plurality 
of stream of packets received at the user at a plurality of 
5 later times. 1 

^ 50. The method of claim 16 further comprising the steps 

storing a first stream of information received by the 
10 user at a first time and 

inserting the first stream of information into a 

Dlural it-v r*-f <r.-K>-.^-*~~ .r _• ^ 

~ , " ^ -i-nrormation received at the user at a 

plurality of later times. 

51. The method of claim 27 further comprising means for 
storing packets received at the user during a first time 
period and means for inserting such packets into other 
packets received at the user at a plurality of later time 
periods. 



15 



20 



25 



30 



35 
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